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(54) Title: SYSTEM FOR DISTRIBUTING PERSONALIZED AUDIO PROGRAMMING 
(57) Abstract 

An audio program and mes- 
sage distribution system in which 
a host system organizes and trans- - 
mils program segments to client 
subscriber locations. The host or- 
ganizes the program segments by 
subject matter and creates sched- 
uled programming in accordance 
with preferences associated with 
each subscriber. Program seg- 
ments are associated with descrip- 
tive subject matter segments, and 
the subject matter segments may . 
be used to generate both text and 
audio cataloging presentations to 
enable the user to more easily 
identify and select desirable pro- 
gramming. A playback unit at the 
subscriber location reproduces the 
program segments received from 
me host and Includes mechanisms 
for interactively navigating among 
the program segments. A usage 
log is compiled to record the sub- 

scriber's use of the provided program materials, to return data to the host for billing, to adaptatively modify the subscriber's reference based 
^S^,^ to send su^ comments and requests to the host for processing. Voice input and control mechanisms 

^^M^ P if y ^ W *jf rfonn b ^ Ss ^ navigation of the program materials and to dictate orniments and messages which 

^^Tl- K^f ^ n*™*^™ to oter subscribers. The program segments sent to each subscriber may include advertising 
maertek wfoch the user can selectively play to obtain credits against the subscriber fee. Parallel audio and text transcript files for at least 
selected programming enable subject matter searching and synchronization of the audio and text files. Speech synthesis may be used to 
convert transcript files into audio format Image files may also be transmitted from the server for synchronized playback with the audio 
programming. r 
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System for Distributing Personalized Audio Programming 



Field of the Invention 

This invention relates to electronic information distribution systems and more 
particularly to a system for dynamically and interactively selecting and playing particular 
programs from a program library. 

Background of the Invention 

The three dominant commercial systems for providing audio programming to a 
listeners are broadcast radio systems, cassette tape playback systems and compact disk 
playback systems. 

Broadcast radio uses both the AM and EM frequency bands making a large 
number of simultaneously broadcast programs available On an essentially random access 
basis. Unfortunately, since most broadcast stations attempting, to appeal to the same 
general listening audience, much of the programming is duplicative and special interest 
programs are broadcast on a limited basis. In addition, because there is no convenient 
way for listeners to be aware of the wide variety of materials scheduled for broadcast, 
most people listen to only a limited number of stations which dependably broadcast the 
programming considered to be most acceptable. Even when desired programing is 
found, it rnust typically be listened to when it is broadcast; that is, at times chosen by the 
broadcaster and not the listener. 

Tape and compact disk audio players .ofier the listener the opportunity to purchase 
specific music selections or albums performed by favorite artists and to replay selections 
from these purchased recording whenever desired. Pushbutton track selection, as well 
as improved fidelity, has made the CD player the preferred choice of many, despite the 
cost Mid iraxMrvema^ Unfortunately, specialized 

information programming, unlike music, is largely unavailable on tape or disk, and that 
media is not capable of adequately conveying rapidly evolving information such as local 
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and world news, weather reports, and rapidly changing trade and business information. 
Although broadcast radio provides adequate, up to the minute coverage of general news 
topics, specialized information continues to be largely unavailable on any of these three 
.aTitfodVtfverysys^ 

to be widely used, particularly in automobiles, for general news and music programming. 

More lecently, "Internet radio" sources has been introduced which make files of 
audio program material available for downloading on the World Wide Web using 
conventional web browsers to locate and request specific files which are then played in 
realtime by special programs, including the popular "Real Audio" program offered by 
Progressive Networks. Although Internet radio systems inake h possftle to deliver a 
richly diverse selection of audio programs to interested listeners on request, including 
specialized information not offered by conventional broadcast media, the use of a visual 
web browser to search for and then play 

conventional Internet radio players impractical for routine desktop use, and wholly 
unsuitable foruse by an automobile drive. 

B is accordingly an object of the present invention to provide easy access to rich 
selection of audio programming and to aUow the listener to dyiiam^ 
locate and select desired programming from the available collection in an easy and 
mtuitive way without the need for a visual d^lay screen md u^ 
controls. . .. 

Summary of the Invpntinn 

In a principle aspect, the present invention take the form of a personalized 
mfbmanon delivery system which provides information and entertainment programming 
toinqUvidualsubscri^ 

and which incorporates mechanisms for selectively delivering a subset of those programs 
to agiven subscriber based on that subscriber's characteristics, subject matter preferences 
and interests, and express requests. 

As contemplated by the invention, the library of programs is created and 
mamtained by a server subsystem to which a remotely located subscriber / pjayer 
subsystem can coimert by means of a con^ 
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i» Internet coimection. The programs making up the library are subdivided into program 
segments, one of which contains an audio presentation of the content of the program and, 
if that content includes a voice narrative, it is preferably accompanied by a text file 
transcript Each program segment is associated with a subject category description which 

s typically describes a plurality of related program segments, and a program topic 
description describes the content of each individual program segment (^mWnations of 
these category and program descriptions which are of interest to a particular subscriber 
are transferred from the server subsystem to that subscriber's player subsystem, thereby 
providing a subject matter catalog from which the subscriber may expressly request 

10 particular programs. 

In the prefemsd embodiment of the invention, to fecilhate use of the system by the 
subscriber, the server subsystem acceito^m the subscriber indications of me 
general interests, characteristics and preferences and this subscriber characterization data 
is periodically matched against the characteristics of each stored program ^ 
identify those segments of significant potential appeal to that subscriber. The catalog of 
programs supplied to the user may accordingly be limited to, or otherwise emphasize, 
categories and selections to which the subscriber's attention should be specifically 
directed. 

In order to match the subscriber's preferences to the programming most likely to 
match those preferences, the server subsystem creates data for each program segment 
characterizing a series of attributes of persons likely to have an interest in that program 
segment The server fortherindudw attributes of each subscriber 

against the attributes of each program segment to form a weighted value indicative of the 
extent to which the preferences of the subscriber match the attributes of the target 
audience for that program. Programs which have the highest weighted value for a given 
user are men brought to the attention of that user, either by including those programs in 
the user's catalog, or by including the program in an actual proposed listening schedule 
when space permits. 

Other aspects of the audio distribution system mdudetechmqjies for ^ 
me listener to add a voice annotation to a program and send the annotated program to 
another hstener, techniques for synchronizing an audio program wM 
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or more stored images, techniques for employing a usage log generated by the listener's 
activity to determine what programming should be distributed to the user, and techniques 
for responding to control commands received from the user in providing the 
programming. 

These and other objects, features and advantages of the present invention may be 
more completely understood by considering the following detailed description of a 
preferred embedment of the invention. In the course of this description, reference will 
frequently be made to the attached drawings. 

Brief Description n ftf, P rir^ 

FIG. 1 is a block schematic diagram of an electronic program and advertising 
distribution system which embodies the invention; 

FIG. 2 is a flow chart illustrating the principle steps followed in the course of the 
performing the information distribution functions contemplated by .the invention; 

FIG. 3 is a flow chart illustrating the principle steps performed during a playback 
15 session in the illustrative embodiment; 

FIG. 4 is ah information stiucture and data flow diagram illustrating the manner 
in which prograinining is selected and accounting functions are performed in the 
ulustnurveernbodime^ofmeinvamon; 

FIG. 5 is an information structure diagram illustrating the manner in which the 
program segments are dynamically selected and played in response to the user's 
preferences and control decisions; 

FIG. 6 is a flow chart which describes a preferred procedure for preparing the 
program content which is distributed to subscribers in accordance with the invention; and 
FIG. 7 is an information structure diagram illustrating the manner in which a 
narrative text file expressed in hypertext markup language (HTML) may be translated in 
to the rombination of an audio speech file, a text file transcript, and a sequencing file used 
by the player to create a multimedia presentation. 
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Description ftf thfr PrAforrfd EmhnHiman* 

The illustrative embodiment of the invention shown in Fig. 1 utilizes the Internet 
to provide communications between a host computer indicated generally at 101 and an 
audio player device illustrated at 103. 

Subscriber Audio Player 

The player 103 may be advantageously implemented by a conventional laptop or 
desktop personal computer including a processor (the client CPU 105)> a time of day 
dock 106, and a data storage system consisting of both high speed RAM storage and a 
!«rsistemiiiass storage o^c^ 

being used for storing audio, text and image data at 107 and for storing usage data at 109 
which records the nature of the prograiintungreproduceclbythepbyer 103. Theplayer 
1 03 further mdudes a sound card 1 1 0 which receives audio input from a microphone input 
device 1 1 1 for accepting voice dictation and commands from a user and which delivers 
audio output to a speaker 1 13 in order to supply audio information to the user. The 
program data stored at 107 may advantageously include compressed audio recordings 
and/or text (ffles of characters) which may be converted into audio form by conventional 
speech synthesis programs executed by the client CPU 105. 

The sound card l io is conventional and preferably complies with the 
recommendations detailed in the Hardw™ iw r a.^ ffrr w^ mi «< 

byD<>ugIdopiens^ 1-55615-642-1. The sound card 

110 aa\antageously suppom a44 k^ 

conversion of audio h^sigiialsirom me microphone 111 as well as digital to analog 
conversion for programmir* direct The sound card provides 

external connections and hardware support for Mcrophone-In, Line-In, Line-Out, and 
Headphones-Out, with volume controlled by me ptoyer software Cmcmding voh^^ 
level logging as discussed later in connection with Kg. 3 of the drawings). 

To support multimedia capabilities, the CPU 105 should meet or exceed the 
capacities of an Intel 486 DX2-66 computer to provide consistently good playback 
results and the sound card 110 should include a 16-bit digital-to-analog converter for 
playback and a HM>h analog-to-mghal converter for recording. The sour^ 
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should fiirther support 8, 1 1,22, and 44kHz wvefonm. Agency of 44kHz is used 
for CD-quality sound and fractions of 44, such as 11 and 22, are often used for 
cranpressedwavefbnm Support for an 8kHz n^uency 

shouMbeinoidertoproperfysupportWmdow ^hich 
is optimized for compression and playback of human speech. Using TrueSpeech 
compression, programs containing largely voice narrative data can be substantially 
condensed, and users can record annotations and voice mail responses as discussed 
later. 

In addition, the sound card 110 should be capable of reproducing downloaded 
MIDI (Musical Instrument Device Interfile) commands, enabling the system take a 
MIDI data stream and produce sound according to the compressed files consisting of 
digital sheet music instructions. Preferably, the sound card should support at least 16- 
voice polyphony (the ability to play several sounds at the same time), and polymessage 
MIDI, an capability included in Windows 95 that allows a sound card to receive and 
batch-process rmihhile^I messages (such as Note The sound 

card 1 10 should also a microphone port for microphone 1 1 1, a speaker-out port (for 
one or two (stereo) unpowered speakers 1 13, and a headphone-out port. 

The personal computer CPU 105 isalso preferably coimected to a c^ 
personal computer video display 118 aiid . a stamlard keyboard 1^ 
device (such as a mouse, trackball or touchpad, not shown). The facilities provided 
by the operating system, such as Windows 95, typically includes multimedia support, 
as noted above, as well as a standard WINSOCK TCP/IP stack and modem dial up 
driver software to support a SUPP/PPP Internet connection, as ne^ 

the player 103 further includes a conventional high speed data modem 1 15 for 
receiving (downloading) the program information 107 from the remote server 101 and for 
traiismiraiig (uploading) program selections and preferences as well as usage data in the 
file 109 to the server 101. To effect these file transfers, the modem 1 15 is connected via 
conventional dial up telephone SLIP or PPP TCP/TP series date comrnun^ 
to an Internet service provider 121 which provides access to the Internet. The service 
provider 121 is in turn connected to the host saver 101 via a high spe^ 
at 123. 
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Host File Server 

The host server 101 provides a FTP server interface i25 which provides file 
transfer protocol services to the player 103, a CGI interface 127 which performs Common 
Gateway Interface script program execution in response to requests from the player 103, 
end an HTML inter&ce 129 which provides hypertext transport protocol (HTTP) World 
Wide Web server functions to the connected player 103. The host server 101 stores and 
inaintains a plurality of data files including a program data library indicated generally at 
130 consisting of a collection of compressed audio program segments 131, announcement - 
("glue") segments 132, text program segments 133, image segments 134, advertising 
segments 135 and program catalog information 137. 

The compressed audio segments program segments comprise audio voice and 
music files which may be compressed using conventional compression mechanisms suited 
to the data being compressed, such as TrueSpeech compression for voice signals and 
MDIfiles for compressed synthetic music reproducible by the sound card 1 10 as noted 
earlier. 

Compressed voice programming in the database 131 may advantageously be 
accompanied by text transcripts (files of characters) stored in the text database 133. 
Srnuany, images stored in the image database 134 may be used to provide a multimedia 
presentation which combines images reproduced on the display 1 18 of player 103 with 
concurrently presented audio at the speaker 1 13 and/or displayed text. Program segments 
which present advertising , fflustratively shown as ^ 

135 in Fig. 1, may likewise consist of audio, text and/or'image segments, as may the 
program segments which provide announcements between program segments as well as 
audible and visible menu options which the user may select as described later. 

As hereinafter described in connection with Fig. 5, each voice or text program 
segment preferably includes a sequencing file which contains the identification of 
highlighted passages and hypertext anchors within the program content This sequencing 
fflemay further cbntamntf^ra to image 

in the audio presentation when each image display should begin and end. In this way, the 
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image presentation may be synchronized with the audio programming to provide coherent 
multimedia programming. 
Ascontem^^ 

newasources, libraries, eto nuy be converted to^c^^ 
I ^«by~iiveiiti^ 

of tat to speech is pntobtypafonned at the cKent station 103 by the player. In this 
way, text information alone may be rapidly downloaded from the server 10 1 once it 
ieo^ much less data than 
initherpmvidesmei^^ 

cases, where it is important to capture me and authenticity of the o 
speech signals, a text transcript file which collaterally accompanies a compressed voice 
audio file may be stored in the database 133 from which a transcript may be made 
available to the user upon request. 

Thehost.server 101 ftrtherstores web page data 141 which is made available to 
the player 103 by means of the HTML internum 128. Tfe host server 101 addmon^ 
stores and maintains a user data and usage log database indicated at 143 which stores 
uploaded usage data received from the store 1 09 in the player 1 03 via the Internet 
pathway 123 and the FTP server interlace 125. The user data 143 further contains 
additional data describing the preferences, demographic characteristics and program 
selections unique to each subscriber which is developed Jargery from user-supplied data 
obtained when users submit HTML form date via the Internet pathway 123 for processing 
by the CKH mechanism 127. 

The host server lOrperiodieaUy transmto a d<)wdoad compilation file 145 upon 
receiving a request from the player 103. Thefile 145 is pl«^ ma predetermined FTP 
download file directory and assigned a filename known to the player 103. At a time 
determined by player 103 monitoringthe time of daydoclcl06,adidupcoiinectionis 
estabMedviatiieserv^ 

download compilation 145 is transferred to the program data store 107 in the player 103. 
The ,compaation 145 ia previously written to the download directory by a download 
im>cessin«mechani m IWoad processiiig, as described 

in more detail later, extracts from the library 130 data ddining compressed program, 
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advertising, and glue segments, and/or associated text program data, based on selections 
and preferences made by (or inferred for) the user as specified in the subscriber data and 
usage log database 143. 

The download compilation file 145, though represented as a single file in Fig. 1, 
preferably takes the form of one or more subscriber and session specific files which 
contain the identification of separately stored sharable files. By way of example, the 
recommended order and the identification of the program files making up an individual 
playback session are stored in a session schedule file (to be described in detail in 
connection with Fig. 5) which contains program identifiers of the program segments to 
be played during an upcoming session. The player 103 downloads the session schedule 
file and then issues download requests for those identified program segment files which 
are not already available in the player's local storage unit 107. 

Usage data in the store 109 maintained by the player 103 is preferably uploaded 
as a file bearing a predetermined file name indicative of the particular subscriber and 
upload time and stored in a predetermined FTP upload directory. This upload 
advantageously occurs at the same time the player 103 establishes a download connection 
to the FTP server 125 as noted earlier, and occurs prior to the download of the 
compilation 145. Because the upload data from the store 109 in the player 103 identifies 
program segments desired by the subscriber, program segments newly requested by the 
User are appended to the compilation 145. Note that, in typical cases, programming in 
addition to the specifically requested programming will be included in the download 
compilation, and the transfer of that programming can begin immediately while the newly 
uploaded user selections and other information are being processed as indicated at 153 to 
identify additional information to be included in the download compilatipa 

As indicated at 161 in Fig. 1, the host server upload processing mechanism 153 
also provides a nund>er of reports, as described m 

of actual player use by mdividual subscribers and me cornraunity of subscribers as a whole. 
This report processing is advantageously performed on a periodic basis in connection with 
financial and accounting functions including subscriber and advertiser billing, content 
provider royalty payment accounting, and marketing analysis processing. 
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It should be understood that numerous . other information storage, processing and 
communications schemes may be substituted for the preferred Internet server and PC 
client player arohhecture shown in Fig. 1. A dedicated host computer which 
ommiiiiiicates directly with client stations via dial up telephone facilities may be used, and 
cellular radio, cable modem and satellite links may be used to provide data 
coimnmucatioM 

mHg.1. To nutate use of me system m an auto^ 
linkedtouwlmenirt 

Hnkwhen the car is parked at the subscriber's home or office The Infrared Data 
Association's (ttD A) wireless infrared (IR) standard provides a highly effective, low-cost 
communicant pat^ 

and PDAs. The IrDA international standard provides interoperability among widely 
diverse systems, involves no governmental regulation, are provided at low cost, provide 
hujhspeedfu>traiufes(e.g, 4Mbs datarates), are small and can be easily incorporated 
into portable computers of the type which may be used in a car or on public 
transportation. Altenativery, the files dowiiloaded from the host may be stored on a^ 
replaceable media, such as an optical disk cartridge, which may then be inserted into a 
portable computer or sinmlified player for mobile use! A direct link between a mobile 
client player (such as a laptop PC) may be implemented using the Cellular Digital Packet 
Data (CDPD) service presently available mmajw metropolitan 
access to the Internet using the TCP/IP protocol, and provides the advantage that needed 
program segments can be downloaded while a session is in progresV, eliminating the need 
for a complete download before the mobile unit is disconnected from its data source. 

Upload and Download Sequence- Overview 

Fig. 2 illustrates the sequence of niajor events wWch are executed the program 
d i ss em i n ati o n system contemplated by the invention. 

As indicated at 203, an interested subscriber invokes programming services by first 
supplying personal information and iiiMd programnn^ 

"totalization procedure. Preferably, as explained in more detail later, account 
initialization is accomplished by presenting the subscriber with HTML forms to complete 
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and submit to CGC script programs which execute on the server to post subscriber 
supplied information into an initial user dataset. Based on the information supplied by 
the user, the server then compiles one or more files for downloading to the subscriber at 
step 207 which include programming and advertising segments as well as additional data 
and utility programs needed by the player 103 to begin operation The download 
operation preferably occurs at a time established by the player which establishes a dial up 
connection via the SLIP/PPP serial connection 1 17 to the local Internet service provider 
121 which provides an Internet connection to me host FTP server 125. The download file 
or files containing programming and advertising segments as well as subscriber specific 
data are designate by filenames provided by the requesting client/player 103 and moved 
from storage unit 145 utilizing the FTP server 125 and the Internet connection into local 
storage at 107 in the client/player 103. The filenames used to specify the files in the 
server 125 may conveniently be formed from the program_id value used internally by both 
the host and the player to identify and differentiate the different program segments used. 

The data downloaded includes a recommended program sequence file which 
provisionally identifies the order in which downloaded program segments are to be played, 
with the initial selection and sequence being established based on user preference data by 
the download compilation processing mechanism seen at 151 at the server. 

Before a playback session begins, as indicated at 211, the subscriber has the 
Opportunity to review and alter the provisional program selections and sequence 
established as a defeult by the downloaded information from the server. Utilizing the 
prograrnrning data and a utility program previously supplied by the server, the subscriber 
may alter the selection and sequence of program materials to be played, including altering 
the extent to which advertising wfll be played along with the selected programming. 

At the request of the user, the sequence of programming defined by the program 
sequence file (the selections file illustrated at 351 in Fig. 5) is then reproduced for the 
listener. As contemplated by the invention, the player 103 includes controls which enable 
the user to easily move from program segment to program segment, skipping segments 
in a forward or reverse direction, or to jump to a particular segment, and thus alter the 
preprogrammed sequence. Nevertheless, when any given program segment concludes, 
the next segment which is specified as following the given segment wfll begin playing 
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unless the listener intervenes. Thus, although the segments are stored in randomly 
addressable locations in the local mass storage unit, they are nonetheless played at step 
212 in the sequence established initially by the server and (optionally) modified by the 
subscriber, with the player providing the ability to dynamically switch to any position in 
this sequence under the listeners control As indicated at 213 in Fig. 2, the listener may 
at any time return to the sequence editing step 211 to manually reorder the playing 
sequence if desired. As indicated at 215, a session usage log is recorded during the 
playback session to identify every segment actually played, the volume and speed at which 
that segment was played, and the start and end times. 

At step 21 1, in addition to deleting and reordering items on the program schedule, 
the user may alter his or her selections and general subject matter preferences to control 
the manner in which the host assembles program schedules for future sessions. When 
programs are included in a current schedule which are of particular interest, the subscriber 
may assign a priomy vahie to the scheduled program and, in that way, inform the host that 
the user has an interest in receiving more programming in the same subject matter 
categories in which the identified program is classified. When a program ma serialized 
sequence is assigned a new or different priority value at step 21 1, the host system 101 
assigns a corresponding Importance value to the programsegment record for each of the 
remaining unplayed programs in that serialized sequence. Note that, by expressly 
approving advertising segments or categories of acceptable advertising in this fashion, the 
subscriber may be granted a rate reduction since advertisers are generally willing to pay 
more for advertising directed to customers having a known interest in a given subject 

At the conclusion of a session, subscriber u given the opportunity at 217 to sd^ 
prograuuning which should be included in the next programming download. To facilitate 
this selection process, agonal programme which f^ subject 
inatter preferences, ateng with additional programming which the server includes as being 
of particular interest, is identified in a catalog (as periodically supplemented by a 
download file seen at 308 in Fig. 4) and presented to the user in the form of a proposed 
program schedule together with a catalog of additional selections which may be 
substituted or inserted into the proposed schedule. At step 219, the selections made by 
the user at 217 as well as the contents of the usage log recorded at 215 are uploaded to 
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the server as a requested file (seen at 301 in Fig. 4). This upload step may occur at the 
same time the SUP/PPP dial-up connection is established by the player 103 to accomplish 
the download, with the upload occurring first by an FTP file transfer from the usage data 
store 107 to the FTP server .125 followed by the downloading of files requested by the 
client 103 from the FTP server. 

In addition to the downloaded catalog of available items which may be viewed by 
the subscriber from the available downloaded information, the user may re-establish an 
Internet connection to the HTML web server 129 which presents HTML program 
selection and search request forms, enabling the subscriber to locate remotely stored 
programming which may be of particular interest to the subscriber. When such programs 
are selected in the HTML session, the user's additional preferences and selections maybe 
posted into the user data file 143 and the identification of the needed files may be passed 
to the client/player 103 for inclusion in the next download request. 

Account Initialization 

As contemplated by the invention, a subscriber account may be established by any 
user having a personal computer equipped to provide the capabilities needed to implement 
the player 103 as described above; together with Internet access via a service provider 
121. AWioughaconveritio^ 

time required for uploading and downloading the necessary files may be substantially 
reduced using higher speed access, such as an ISDN or cable modem link, when those 
services are available. 

To estabfish a new account, a prospective subscriber may use a conventional web 
browser program, such as Mosaic, Netscape Navigator or Microsoft's Internet Explorer, 
which executes in the dient CPU 105 to establish a conventional HTTP request/response 
dialog with server 101. The account initialization begins wim me transmission of m 
HTML form from the web page store 141 which is completed by the user at the keyboard 
(not shown) of the client CPU 105. The account information is then transmitted to using 
a HTTP post method directed at a form processing CGI script executed by the server at 
127 to place descriptive information about the user in an assigned user data file as seen 
at 143. After the. account has been established, utility programs and data may be 
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downloaded from the FTP server 125 to the diem/player* 103. These utility programs 
advantageously include programs which perform functions including (a) program 
decompression, playback and navigation; (b) recording of a usage log file identifying the 
program and advertising segments played and the start time, ending time, volume level and 
playing speed for each such segment; and (c) the selection and updating of programming 
preferences and selections for future downing/ting 

The data fields supplied by a new subscriber at the inmaCzation step 203 may 
iidvantageousry include the user's full name and billing address, credit card information 
or the like for use in subscriber billing; and descriptive data about the subscriber (and 
others who may share the dowrioaded material), such as: age, profession, sex, and marital 
status; the identification of subject matter categories of interest to the subscriber, 
preferably with assigned weighting factors indicating the level of interest in each category. 
The subscriber may also indicate general preferences with respect to the including 
advertising, including an indication of the amount of advertising which is acceptable to 
defray subscription costs, ranging from fully advertised programming for minimum 
subscription charges to the compter 

In addition, the subscriber may request and be presented with an HTML form 
which Hsts available programs in a particular selected subject matter area, with a priority 
weighting factor pre-assigned to each in accordance with the subscriber's previous 
specification for mat category. The form presented thus reflects the previously entered 
level of interest weighting factor for each program based on its subject matter category, 
but permits, the subscriber to override the suggested default value on a program by 
program basis. Sirmlarfy, the subscriber is given the opportunity to override the default 
amount of advertising desired. 

Advertising may be associated with particular subject matter categories as weU as 
with particular programs. For example, an airline may wish to advertise generally in 
connection with programming in the -travel" category whereas a particular resort hotel 
may wish to advertise only in connection with a particular travelogue program for the 
region where it is located. Subscribers may wish to hear advertising in connection with 
the programming m the travel category, but to eliminate commercials from a daily 
program presenting today's weather report" The result is dearly advantageous for the 
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advertiser, since advertising is focused more clearly on those having an interest in the 
subject matter and an expressed willingness to listen to commercial messages, while the 
subscriber is able to receive advertising which may be regarded'as useful while eliminating 
unwanted advertising. 

Because personal data describing each subscriber's subject matter interests is 
available, along with personal data (age, marital status, zip code, etc.), particular 
advertising segments may be directed to only those subscribers having a likely interest in 
the goods or services advertised. This targeted advertising need not be presented at any 
time during the playback for the designated subscriber and need not be timed for 
presentation with particular programs. For example, a subscriber indicating an interest 
in travel programming may be supplied with acrvertising from an airline at any time, and 
not necessarily concurrent with selected travel programming. 

Because a subscriber may have a particular interest in or enjoy some advertising, 
and may have a particular dislike for other specific advertising, the user may 
advantageously be presented with a listing of advertising organized by advertiser and 
subject, providing the subscriber with me opportunity to select additional desired 
advertising on the list while suppressing others: Since the voluntary acceptance of 
advertising preferably reduces the programming charge to the subscriber, the utility 
program which executes on the client CPU 105 to enable program and advertising 
selection, sequencing and editing preferably provides an advisory indication to the 
subscriber of the charges or credits to be accrued if the currentiy programmed sequence 
is played. This feature enables subscribers to better control the costs of the service by 
accepting sufficient advertising content to reduce the subscription cost to an acceptable 
level. Subscribers may also set a player system variable to a value indicating the 
subscription costs per unh time that the subscriber is willing to accept, and the player 103 
can then autornancally insert advertising segmeiits between program 
quantity to achieve a net charge at the desired level. 

Player Operation 

The playback operation indicted generally at 212 in Fig. 2 is illustrated in more 
detail in Fig. 3. 



15 



WO 99/43111 v 

. - PCT/US98/03444 

In order to fimtt access to the downloaded programming materials to the 
subscriber or persons authorized by the M*^**^^,^.^ 
onthedientCPUlOSO^ D advantageously begins ftese^onbyre Q uestingtI«e B try 
ofapass W ordasindicatedat231. The entry ofthis or a different password mayalsobe 
r^forac^totheutilityprogran^ 

future program selections, and current program selections and sequencing. Similarly 
mformation which mig^t be revealed concerning an individual subscriber by the ho* 
server 101 is advantageously password protected. 

AswhtaUInten^transaca^ 
than publicly available programming may also be encrypted. To this end, the client and 
server ends of thepathwaymay exchange pubfic to enable encrypted tran^ 
usuigcoixventmi^RSAenc^on. By placing the decryption capability within the 
capabffi^oftheplavbackunft 

s^'sspe^and display^ 
usage account mechanism cannot 

segments using other means. In addWon, ami as a part of tms secure 
arrangement, the host system can be programmed to require me receirt of m 
usagelog^m which subscriber and advertising charges and content provider payments 
can be determined) before releasing addmonal programming materiab for do^ 
from the FTP server 125. 

As described in more detail later in comiection with Figs. 4 and 5, the sequence 
Pfprogram segments to beriresentedto theuserism^ ffl( , (8een ^ 3{yj 

mRg. 4) consisting of a sequence of program segment identification numbers which are 
used to compile a seo^encing file, called the selections file, illustrated at 351 in Kg. 5 
which contains more detailed information about the sequence of events which occur 
duringplayback. The player obtain, inforniationfiom the sdections ffle which identifies 
meindMAidprognmisegme^to 
asweflasmesegmemio^^ 
in the manner illustrated in Fig. 3 . 
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As indicated at 233, the playback session begins with the presentation of an audio 
(and/or displayed) menu which allows the user to jump to any program segment within 
that sequence to start (or resume) playback at 235, or terminate the session at 236. 
The playback operation itself continues from the designated playback point in the 
selections file (seen at 351 in Fig. 5) which follows a program sequence initially created 
by the host server and downloaded with the program segments themselves, and then 
(optionally) modified by the addition, deletion and re-sequencing of segment identifiers 
as discussed earner in connection with step 211 in Fig. 2. Note however that, if the user 
elects to have advertising segments automatically inserted between program segments to 
achieve a predetermined cost level, that insertion occurs under the control of the playback 
mechanism at 235 such that advertising segments not identified in the selections file may 
be added or advertising segments specified in the selections file may be automatically 
slopped. 

As playing progresses, the current playback position may be advantageously 
• indicated by a variety of means. In the most simple form, the current playback position 
within the session file of selections (discussed in more detail in connection with Fig. 5) 
may be indicated by a simple numerical readout indicating the position on a scale of 1-100. 
Jn this way, a user listening to the programming in scheduled order is provided with an 
indication of the duration of prograrnming reiriaining to be played. In a player 
implemented by a personal computer provided with a screen display, the current playback 
position may be advantageously indicated by displaying the program segment topic 
descriptions in a scrolling listing, with the description of the program currently being 
displayed being highlighted. The scheduled duration of each program segment maybe 
displayed, along with the elapsed time remaining to be played in the currently playing 
segment, to enable the user to more easily determine when to skip the remainder of the 
cunenuyphying segment When such a concurrent visual display isavailablei means may 
also be included to respond to the users selection of a given program on the scrollable 
listing by means of a mouse or the like, and then automatically continue the play at the 
beginning of the program segment thus selected. 

Each time the playback begins a new programming, advertising or announcement 
segment, the segment start time is recorded in the usage log file stored at 109 (Fig. 1). 
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Each usage log record contains a program segment identification number (ProgramID) 
obtained W the selections file as well as a start time and date stamp encoded into a 32 
bh dale-time value, a volume level setting indicating the volume at which the player was 
set at that time, and a playing speed value indicating the playing speed or playing being 
used. 

As indicated at 237 inKg. 3, each time a ^new program se^mert is started, a hew 
segment handling procedure is executed at239. If the user desires to have advertising 
inserted to defray the costs of the subscription, the current actual cost per unit time is 
calculated imdcompa^ ffthecostisdeterrninedto 
exceed the desired level, an additional advertising segment is started; otherwise, the next 
program segment in the program sequence 214 is played. In either case, the segment id 
of the newly starting segment is recorded in the tog file along with the start time for that 
segment Note that ft is unnecessary to record the end time forthe prior segment since 
it is the same value as the start time for the next segment When play is concluded, a 
tenninating record indicating the time of turnoff is recorded to enable the duration of the 
last segment to be calculated. 

Recording Volume and Playing Speed Changes 

As indicated at 251, if the user changes the volume level or playback speed by a 
significant amount, a new record is posted to the usage log at --253, indicating the 
continuation of the last program at a new volume level (thus producing two records in 
semience haymg the same program wgm 

and volume levels). The user adjusts the volume by means of a software control 
displayed when the player is active. The user adjusts the control using the mouse or 
keyboard to adjust the volume. When the volume control experiences a change in level 
greaterthan a predetermined deviation, it sends a message to the pl^ 
causethenewwlunieh^ New volume settings do not affect the 

program sequence and the recordmg cf the volume ie^ 

tomeuser. Likewise, when the user changes me playing spe^ or swftches to higMght 
mode, the new playing speed setting is recorded (using the PlayingSpeed variable in a 
Usage Record, to be discussed) 
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The cost accounting program which calculates subscriber charges and fees to 
advertisers may thereby treat volume levels below a predetermined threshold level, or 
playing speeds in excess of a certain level, as being equivalent to skipped progranuriing. 
In addition, if a subscriber reduces the volume on selected programs or programs in 
particular subject matter categories, frequently increases the volume for other programs 
or subject matter categories, or sets the playing speed to play highlights only of other 
programs, that data can be used to infer preferences and dislikes which can be used to 
better select desired programming to be included in future download compilations. 

User Playback Controls 

The player mechanism seen at 103 includes both a keyboard and a microphone for 
accepting keyed or voice commands respectively which control the playback mechanism. 
As indicated at 261, the receipt of a command, which may interrupt the playback of the 
current selection, and the character of the command is evaluated at 262 to select one of 
six different types of functions. 

The player 103 responds to the first command, "Accept" indicated at 263, by 
temporarily suspending the playback in order to accept a spoken "comment" from the 
user which is recorded as indicated at 264. After the conclusion of the comment, control 
is returned to 261 to test for additional commands before playback is resumed at 235! As 
described in more detail later, comments dictated by the user are saved and later uploaded 
to the host system where they exist as program_segments. By allowing the user to dictate 
and record comments, the system provides a number of useful capabilities, including 
I»sting comments and messages to the host (requests for help or additional information), 
posting comments and messages dmerprivatety or pronely to the originator of a program 
segment being played, thereby enabling private interchanges to occur between users, to 
enable the interchanges to take place in publicly available threads analogous to the UseNet 
and Ustserv newsgroups employed on the Internet to facilitate public discussions related 
to predetermined topics. Li addition, the ability to accept and upload user-generated 
comments and information provides a valuable mechanism by which the user can evaluate 
and comment on the program material being provided by the host. As described later in 
connection with Figs. 5 and 7, the mechanism seen at 263 and 264 for introducing a pause 
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in the session playback while a voice response or comment from the user is recorded can 
also be employed to produce program generated prompts which request information 
followed by automatic response recordings, thereby enabling the system to be used to 
collect data, program evaluations, and other information from the user.* * 

A first command, "Go" indicated at 265, causes the player to make an immediate 
shift to a different program segment. For example, the spoken voice command "FIVE" 
can indicate a request to go to a -predetermined numbered program segment while the 
spoken command "NEWS" could switch to the subject announcement segment for news 
programs. Alternatively, a mouse dick on a screen-displayed menu of items, or a push- 
button on a hand controller connected by an infrared link to the player computer, could 
sinulariy be processed as a command to go to a predetermined program segment 
associated with that command signal. In such cases, the system records the start of the 
new segment on the log file (seen at 215. in Fig. 2) at 267 and switches the current 
playback position in the program sequence file 214 to the new setting at 269, and the 
playback continues at 235. 

In the preferred arrangement, described in more detail in conjunction with Fig. 5 
of the drawings, the program being played may contain passages which relate to other 
program segments in the compilation. These passages may be indicated by direct 
announcement, such as: "Say 'Go' when any of the following automotive companies are 
named to obtain additional information: .. Ford ..General Motors .. Chrysler .. Honda .." 
Alternatively, an audible cue signal, such a distinctive tone or chime, might immediately 
precede a passage which anchors a link to another program segment. Players equipped 
with stereo audio output capabilities can make cues distinctive by playing cued 
announcements in one stereo channel, with or without a supplemental cue signal in the 1 
other channel. When a cue signal indicates a hyperlink passage, a simple "Go" voice 
command causes the player to reset to a new location from which playing continues until 
a "Return" command, seen at 266, causes the player to return to the original sequence. 

As discussed later in connection with Fig. 5, hyperlinks of this type may be used 
to identify program segments which are not available in the player 103 because they were 
not downloaded for inclusion in a scheduled sessioa In that event, the "Go" handling 
routine seen at 265 posts a record to the usage log containing the ProgramID of the 
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requested but unavailable segment so that the requested segment can be included in the 
Requested fi)e 301 seen at 301 in Fig. 4. . 

When a communications pathway such as an Internet or cellular phone link is 
available to connect the player 103 to the server, an immediate request may be sent to the 
server to download a needed but locally unavailable segment. Li that case, the 
dowidoading and playing may proceed concurrently by placing the downloaded 
information into a memory buffer to which the downloaded program segment is written 
as it is concurrently read for reproduction as described U.S. Patent 5,371,55 1 issued to 
James Logan and Daniel F. Goessling. To eliminate breaks in the program sequence, the 
player 103 may advantageously perform a look-ahead operation, sending a file request to 
<he file server via the communication link by pre-scanning the program sequence file 214 
to identify program segments to be played which are not in local storage and requesting 
those segments before they are needed. 

Because announcement or "glue" segments are frequently repeated in different 
program segments, these segments are preferably retained in local storage by the player 

- to avoid the need to be downloaded. The player advantageously processes the usage file 
at the end of each session and tags each program segment which has been played as being 

.eligible for replacement to make room when necessary for incoming segments. 
Amouncement segments, however, are preferentially retained even though they have been 
played because of the higher probability they may again be included in upcoming session 
schedules. 

The third command, the SKIP command indicated at 275 in Fig. 3, causes the 
player to advance to the beginning of the nert program segment in the program sequence, 
recording the start of the next sequence at 267 and resetting the playback position at 269. 
If the program segement has been subdivided (e.g. into paragraphs), the SKIP command 
causes the player to skip forward to beginning of the next subdivision within that segment 
If desired, SKIP commands may be subdivided into two types, a SKIP TOPIC command 
and a SKIP SUBJECT command. When progratnming material such as news reports are 
grouped into topics whhin subject categories, as described later in connection with Fig. 
5, a SKIP SUBJECT command allows the user to skip over all program segments within 
that subject and resume playback at the leading description of the next subject. In 
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contrast, the SKIP TOPIC command always advances to the next topic (program segment 
or program segment subdivision) in the sequence. If desired, the SKIP TOPIC command 
can produce a jump to the next program segment or subdivision which does not contain 
advertising, making it unnecessary for the listener to listen to advertising while scanning 
the program sequence for the next desired program segment 

The BACK command indicated at 278 operates like the SKIP command but in the 
reverse C Wd w ) directioa Similarly, the BACK roirimand irmy be subdivided imo 
two commands, a BACK SEGMENT and a BACK SUBJECT command, which 
respectively reset me playbaA ^ 

begmningoftoepriOT^ Note that, after any. given segment has played 

for a predetermined amount of time, tlie BACK coimnandsto^ 
beginning of the current segment or topic respectively, allowing the user to start the 
current segment or topic from the beginning unless the playback point is already near the 
begmning, in which case the transition is made to the prior segment. The system 
responds to BACK commands by resetting the playback point to the desired point in the 
sequence and recording the start time, vohiiwssetu^ 
log file as indicated at 267. 

In the preferred form of the invention described in more detail in connection with 
Fig. 5, the context sensitive SKIP and BACK commands are used instead of the SKIP 
TOPIC, SKIP SUBJECT, BACK TOPIC and BACK SUBJECT commands discussed 
above. In the preferred arrangement, the program materials include subject and topic 
antiouncement program segments m addWcm to the program segrnern^ 
and advertising). When the user issues a SKIP or BACK command while the player is 
paying a subject or topic announcement, the player skips the entire subject Or topic being 
announced and moves to the next subject or topic announcement respectively, 
autoiiiatic%byr^ 
subject or topic. 

The fhtt co!rmumcU 
iDtotheusagetogwh^ 

which the listener wishes to desigiiate for fiiture use. In its simplest form, the bookmark 
recording function indicated at 28 1 may simply record a bookmark and the ProgramJD 
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of the current program segment into log file. By bookmarking a program segment, that 
segment may be recalled by the subscriber and all or part of it saved tor later use in local 
storage, from which it may be reproduced, forwarded as an attachment to an email 
message, and the like. 

More elaborate bookmark functions which may be readily incorporated into the 
system if desired include the following: 

a. Dictating or keyboarding an annotation at a predetermined position in the 
bookmarked program segment, the annotation-being saved in local storage so 
that, when the bookmarked program segment is reproduced, h will include the 
annotation. Hie bookmarked program segment and the annotation may then 
be saved as a unit tor future reference or forwarded to another person. 

b. Bookmarked program segments, or annotations to bookmarked program 
segments, may be used in conjunction as an auxiliary audio voice mail and 
email handling system in which a subscriber's email and voice mail hems are 
organized as topics in the playback session, enabling the subscriber to 
bookmark particular incoming messages (program segments) for further 
attention, or to dictate voice mail responses, or responses that can be 
converted to text form by a human typist or by a voice recognition system, 
this aspect of the present invention allows the subscriber to review and 
respond to incoming email and voice mail messages while commuting or 
traveling to more productive^ utilize travel time. Voice annotations may be 
stored in separate files which are uploaded to the host with me usage file and 
keyed to the program segment I>ass8ges wWch they aiinotote by records in the 
usage log file. 

The sixth command type, the "MENU" command indicated at 283 in Fig; 3 
switches the player to a predetermined menu program segment, records the start of a 
menu mode state in the log file at 285 and places the player in the menu mode at 233; 
Using a hands free voice command system, the player may reproduce a menu program 
segment in which a sequence of options are enunciated on the system's audio output 
speaker with short pauses between the recited options. By providing the voice command 
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^"duringorsho^ 

that selection. Menu options of this type may be conveniently in^plemented using the 
hyperlink eapabilhy described later m connection with Rg. 5. Alternatively, as noted 
earlier, the menu of options may be displayed on the screen with the desired playback 
pou* being seiectedusingthekeyboard or a pointing device. In all cases, each transition 
toanewprognunseginemi^ 
and ' 



Program Compilation & Bflling 

Kg. 4 illustrates the principle data processing steps and information structures 
employed by the preferred embodiment of the invention to compile progranuning 
information personalized to the preferences of individual subscribers, to perform 
accountmg&nctions wMchprc^ce billing charges to subscribers and advertisers, and to 
determine royalty payments due to content providers. 

The ^gram, advertising and announce* segments to 
mdrWdualsub^in^ 

thesupphedcatdogofrecommendedprogran^ or additional selections chosen during a 
dial-up dialog with the host, as ^M^^^,^^^^ ^ hk ^ 
2. The selections made by and uploaded from the subscriber take the form of a file 
(sequence)of32bhinteger 8 , each integer (Program©) designating particular program 
segment. This file of integers is placed m^relauoi^ database Requested Table seen at 
301mFig.4, withesch rpw (record) in the Requested Table being an iden^^ 
number which specifies a corresponding record (row) in a database table 303 called the 
Programs Table. The Requested Table 301 includes not oidy express requests fomi the 
user based on catalog selections but also requests which result from failed hyperlink 
requests which occur when the listener requested hyperlinked 
sessionwhich was unavailable in local storage at the player. The program segments 
(which include programs, advertising and announcements) have a plurality of attributes 
which are described in the data fields of each record (row) in the Program Table 303 
Tte&llm^Pascaltypedecla^ 
Table 303: 
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Type 

Classtype = (advertisement, program, announcement); 
Program_Segment = record 

ProgramlD: integer, { unique key } 

ProviderlD: integer, 

Class: Classtype; 

URL: pchar, 

Created: datetime; 

SubjectDesc: integer, 

TopicDesc: integer, 

GroupLD, Episode: integer, 

CommentOn: integer; 

Subjects: anay(0.. IS] of integer, 

Importance: array[0..1S] of integer, 

Youngest, Oldest, male, female: byte; 

HouseLow, HouseHigh: byte; 

Duration: integer; 

Plays: integer, 

TotalTime: double; 
. PlaysRate, TimeRate: integer, 

Timeliness: integer, 

end; 

Each ProgramJSegment record in the Programs Table 303 is identified by a unique 
key integer value, ProgramlD, which is the primary key value upon which the Programs 
Table 303 is indexed and accessed. The ProgramJSegment records in the Programs Table 
303 are relationaily linked using the ProgramlD key to other tables including: 

(a) the Requested Table 301 discussed above, 

(b) a Schedule Table .307 which contains the recommended sequence of 
« ■ 

program segments for the next playback session, 
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(c) a New_Catalog Table 308 which contains the identities of new available 
program selections to be added to the subscriber's catalog of available 
programming, and 

. (d) ™ Advertisers Tab^ 

program segments to be brought to the attention of the subscriber. 

The relational database system employed by the preferred embodiment of the 
invention&rther includes a Subscribers Table 313 which contains information describing 
eachsubscrfcer, ^ ^ ^ 

or firm which supplies royahy^earing information for dissemination to subscribers, and 
an Advertiser Table 317 which contain information abo^ 

advertising program segments to subscribers. Mailing addresses and other information 
for subscribers, content providers and advertisers iscontaihed in a single Account Table 
321 to simplify the data structures needed. 

AUsage^Log Table seen at 333 is uploaded from the subscriber, typical* at the 
sametime the express program requeste m the Requested Table 301 are tra^ 
processed at 350 toupdate the Subscribers Table 3 13, the Content Providers Table 315 
meAdveruWntsTable311, the Programs Table 303, and the Requested Table 301 as 
described below. ' 

Program Schedule Generation 

- ^ a ^ rf ^wimmemveimon,mehos^ 
user's initial selection of a sequence of desired programs, first by adding the program 
selections specified infixed hypertext requests as indicated by the UsageJLog Table 333 
duringusage log processing at 350, and men by adding advertisements, announcements 
and additional program segments tailored to the subscriber's known preferences as 
inm(^at340m^^^ 

is transferred to the subscriber, along with program segments, during the download 
transfer. Indeed, if the subscriber pnivides no selections at aD, me host wffl p^ 
Schedule Table 307 containing program segmem sdected eimrety by the host on the 
subscriber's behalf The programs, advertising and announcement segments which are 
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added to the Request Table 301 to form the Schedule Table 307 are determined by a 
matching procedure 342 which may be better understood by first considering the content 
of the data structures which provide data utilized to make those selections. 

The Programs Table 303, as noted above, contains Program_Segment records 
which describe the nature of each programming, advertising and announcement segment 
in the library which is potential^ reproducible by the playw As illustrated by the type 
declaration above, each ProgranvSegment record specifies the. account number 
(Provider©) of the advertiser or content provider if any who may be charged or 
compensated for the actual playing of the program segment by subscribers. The record 
further contains a Classtype variable Class which indicates whether this segment is an 
advertisement, a program, a comment or an announcement. 

The Class variable may also used to further subclass each program segment; for 
example, program segments which hold user-recorded comments may be designated as 
being "public" comments made generally available to all subscribers, "private" comments 
to be directed solely to the provider of the program segment commented upon, and 
"host" comments to be directed to the host system. 

The Program_Segment record's URL field specifies the location of the file 
containing the program segment in the file storage facility indicated at 304 in Fig. 4 (i.e., 
normally on the FTP server 125 seen in Fig. 1, but potentially including storage areas on 
the web server 141 or at any other accessible location oh the Internet). In addition, the 
subscriber may wish to designate for future play a program segment already loaded into 
the player 103 by virtue of a prior download. The subscriber may elect to include an 
already loaded file because it was not reached in a prior playback session or because the 
subscriber wishes replay the selection. In that event, the Program© of such a selection 
is nonetheless included in the uploaded selection list (Requested Table 301), recognizing 
that at the time of actual download, the player 103 will only request the transfer of those 
program segments nrt already present ml()cd storage. The uploaded Requested list 301 
should accordingly be understood to be indicative of the requested content of a future 
planned playback session and not necessarily a listing of programs to be downloaded. 
The selection of files to download is preferably made by the player which issues FTP 
download requests from the server by specifyii«tlieURUofme needed files. 
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The Created field contains a timestamp value specifying the data and time of day 
the program segment was created. In Created field allows user or host to select program 
segments by date and permits the fisting of segments in chronological order in program 



The Program_Segment record former contains a SubjectDesc field and a 
TopicDesc field, both of which take the form of Program© integers which identify other 
program segment records which contain detailed information on audio announcement and 
displayabletextdescriptio^ The descriptive text files for subjects 

and topics are displayable by the player 103 as part of descriptive catalog entries which 
enable the user to choose desired segments. Together, the subject and topic program 
segments provide a hierarchical catalog listing which provides the descriptive information 
about the associated content segments which enables the subscriber to make informed 
selections. The text specified by the SubjectDesc and TopicDesc fields may be searched 
using conventional keyword searching techniques to permit the subscriber to locate and 
Mortify particular programming of from the locally stored catalog or, in a dial up 
<XH interaction with the host, to list and select programs from the larger library available 
on the server. 

Serialized Programs 

As contemplated by the invention, programming may include serialized sequences 
of programs. A given program segment may represent an episode in a series which is 
selected as a group by the subscriber, or a subscriber may select an individual program in 
a serial sequence and the host may then further installments or related programs within the 
series to the catalog or session content thereafter sent to the subscriber. The 
^gram_Segment record contains a GroupID field which specifies the series as a whole, 
and an Episode integer field specifies the position of the given program segment within 
me serialized sequence. When a serialized sequence is requested, the host may download 
fte entire series in one download for pkyback at requested intervals, or less tl^ of the 
episodes when all are not yet available or when it is desirable to limit the total download 
content When a subscriber selects and plays a given program segment, as indicated in the 
usage log, without having expressly selecting the entire series, the host may then add the 
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next installment to the catalog or the next proposed session. If desired, a hyperlink (to 
be described) may be placed at the conclusion of each installment which specifies the next 
iiKtellment as the linked program segment. Inthis way, the listener may request that the 
nejetmstaltaiertoep^ 

Ofit is unavailable and the hyperlink fails). 

Hie usage log may be employed to insure that the subscriber has an opportunity 
to hear episodes that may have been skipped. By monitoring the usage log, if an episode 
included in any given proposed session was not in feet played, the host may include it in 
. the next proposed session as well. Note further that the serialization mechanism which 
has been described can be used to provide serialized advertisements to a subscriber, 
insuring that a subscriber does not hear a particular ad twice and further 
advertising is presented to the subscriber in the intended sequence. 

In addition, the serialization mechanism may be used to provide sequential 
presentation relationships between related programs. For example, if a subscriber 
iruhcates an interest by selecting and actuaUy playing a program on an evolving topic; for 
example, a news story about the America's Cup yacht races, further new stones on that 
topic may be assigned the same Group ID number so that they are automatically routed 
into the subscriber's catalog or program session if space is available. 

fields supporting "Comments" 

Serialized programs are related to, but should be distinguished from, the parent- 
child relationships that exist between program segments and the annotations and 
comments made on those program segments by users. As noted earlier with respect to 
the Acceptcoininand seen at 263-264 ofFig. 3, the player 103 ofFig! 1 permits the user 
to create an "annotation" or . "comment" (typically in the form of a recorded audio 
message or a keyboarded text message) which is uploaded to the host 101 and stored as 
a program segment The ^ConmentOn field of the Program.Segment record contains the 
Program ID of the program segment commented on, the Provider© field identifies the 
subscriber generating the comment, the Created field specifies the date and time when the 
comment was recorded, and the default values of the subject matter fields (discussed 
next) are copied from the subject matter fields of the program segment being commented 
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on. These field entries provide a mechanism for supporting the comment handling 
features which are described in more detail below under the heading "Comment 
Handling." 



Program Selection 

The J^gram_Segment record further incmdes a Subjects field which ban array 
of 16 integers, each of which may be a non-zero code value indicating a predetermined 
subject matter categories, aHov^eacfc programming segment to be matched against like 
codes specified as being subjects of interest by the subscriber, as wen as codes indicating 
subjects to which advertised goods and services may relate. 

The Program_Segment record also contains an Importance field which is also an 
array of 16 integers which (at least initially) holds an integer containing the 
reviewer/editor's assessment of the 'importance" of the program segment relative to the 
subject matter code specified in the corresponding cell in the Subjects array. Thus, if 
SubjectsfT] = 12345 and Importance[7}=231, this program segment has been assigned a 
importance level of 231 with respect to the subject specified by code 12345. Another 
segment may also be relevant to the same subject, but with a different level of importance 
to that subject. These fields may be used by the host as a wdghting factor used to route 
programs of greater probable interest to the subscriber. Note also The "importance" value 
associated with any given program may also be adoptively altered based on the actual use 
asreftectedbytheusagelc^a^ Byway of example, 

program segments which are started but frequently slopped while in progress may have 
their importance value decreased while program which are frequently selected from the 
catalog and listened to may have their importance values increased. In this way, the 
system adaptivery learns, for each categoy or programs, which programs subscribers 
have found to be of interest and which ones were seldom used. Serialized programs 
(identified by a common Group ID) may be assigned importance values based on the 
actual usage of earlier episodes in the same series. Thus, when a series proves to be 
popular based on repeat selections of its episodes, all episodes Cinduding those not yet 
issued) may be assigned a higher importance value. 
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The Youngest and Oldest fields (each storing a byte value 0-255) contains an 
indication of the age range to which a particular program segment should appeal. 
Similarly, the byte values Female and Male allowthe entry of an estimate of the relative 
interest of a given program to the different sexes: thus, a program devoted to sports news 
could be assigned the values Female=60, Male=170 where the value 127 would indicate 
genderrneutral content. The MaritalStatus field is a single character ("S"=aingle, 
"M"=married, "W'^widowed, "D"=divorced). 

Thefidds&JuseUwaiidHouseHig^ range of household sizes range 

that may have a special interest in the program segment, Thus, prograinining directed to 
femily interests may be directed to subscribers who are married with a household size 
equal to 3 or more. 

The Duration field of the Program_Segment record specifies the duration of the 
program segment expressed in seconds, the Plays field is an accumulator field which is 
incremented by incoming Usage JLog records to reflect the total number of times a given 
program segment has been actually played by ajl subscribers. Sfeulariy, the Totalf ime 
value represents the total time a given program segment has been actually played by users. 
Together, these records can be used to determine the advertising fee due from the 
advertiser, or royalty amount payable to the content provider (the advertiser or content 
provider being specified the Provider© field) for the use of this segment. 

The Program_Segment record contains two signed integer values, PlaysRate and 
TimeRate, permitting an advertising charge or royalty payment (Amount) to be calculated 
as a value calculated by the executable formula: 

Amount := (Plays • PlaysRate) + (TotalTime* TimeRate) "". 
IfPlaysRate = 0, the amount of the royalty or advertising fee for actual use of the segment 
can calculated based solely on the a<^ time durstionrfthe played segmem 
credit or charge is assigned if the segment is begun but then skipped). Alternatively, if 
rimesRate=0, the charge can be based solely on the number of times playing the segment 
was commenced, which may be deemed appropriate when it may be considered the 
respoiisibilhy of the advertiser or the content provider to hold the user's attention once 
a segment begins. Note that, as usage records are posted to increment the Plays and 
TotalTime fields in the Pr6gram_Segment records, as described later, any program 
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segment which was played for less that a predetennined minimum amount of time may be 
disregarded, enabling the sub 
information P««egmemtv^ 
fees or royalty payments. 

Program segments are selected for inclusion in the output Schedule Table 307 
and/or the NewCatalog Table 308 by comparing the content of the Programs Table 303 
the SubsoftersTab^^^^ The fields contained in 

the Subscribers and Advertisements Tables are set forth in the following Pascal record 
type declarations: 

Account = record 

AccountNo: integer, { Unique key } 
Name, Title, CompanyName: pchar, 
Addrl, Addr2, City: pchar; 
State: stringp]; 

2p code, AreaCode, Phone, Fax, Email: pchar; 

end; 

Subscriber = record 

AccountNo: integer, • 
Birthdate: Date; 
- Sex, MaritalStatus: Char, 
HouseholdSize: byte; 
Interests: array[0..15] of integer, 
TopChoices, ChoiceCounts: array[0..15] of integer, 
ChargeLeveL- byte; 
DataRate: Integer, 
Capacity: Integer, 

WeekDays: array[0..6] of Compilation; 

end; 
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Advertisement = record 

ProgramID: integer; . . 

AccountNo: integer, 
DemographicMatch: functionid; 
DemographicWeight. byte; 
Earliest, Latest: datetime; 
Subscribers: integer, 
Repeats: byte; 
end; 

The Accounts Table seen at 321in Fig. 4 is indexed by a key value AccountNo 
which is unique to each of its Account records. The fields of those records contain name, 
mailing address, telephone, fax and email information for all subscribers, advertisers and 
content providers in a single shared file. A person or firm specified by a record in the 
Accounts Table could simultaneously be a subscriber, advertiser and a content provider, 
in which case the same AccountNo key value would appear in each of the three tables: 
Subscribers 313, Content_Pr6viders 315 and Advertisers 317. Prospective or inactive 
subscribers, content providers and advertisers may also be described by entries in the 
Accounts Table which are not referred to in any other tables. 

Additional infonnatibn about each active subscriber is contained in the Subscriber 
record indexed by AccountNo (a key shared with the Accounts Table). The Subscriber 
record specifies personal information about the subscriber, including birth: date (from 
which age may be detennined), sex, marital status, and household size, all of which may 
to of usefobetter sdecm^ should be brought 

to the attention of the subscriber. 

Each Subscriber record further includes two arrays of integers which indicated the 
subscriber's subject matter preferences. The interests array contains 0 to 16 integers each 
indicating a subject matter category of interest to the subscriber, the integers having the 
same meaning and being take from the same categoiy listing as the integers phcedmth^ 
Program_Segmettt record's Subject array. These integers are placed in the Interests array 
in response to the subscriber's indication of subject matter preferences when the account 
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is established as indicated at 203 in Fig. 2 or at any time thereafter when the subscriber 
elects to modify the stated preferences at step 217 in Fig. 2. 

A second array of 16 integers called TopChoices is ah ordered list of the same 
subject matter integers; however, in this array the subject matter integers are listed in 
5 order of actual playing frequency as indicated by the parallel array of ChoiceCounts 
integers. For example, the subject matter integer 321 in TopChoices[3] and the count 18 
in ChoiceCounts[3] indicates that 18 selections had been played m me category 32rw^ 
was the fourth most-frequently played category. The ChoiceCounts array is modified 
whenever the usage tog indicates that a selection in a particular category has been played 
10 by that subscriber. As a consequence, the TopChoices and ChoiceCounts arrays provide 
an indication of the subscriber' s interests as indicated by his or her actual use of the 
player. 

The ChargeLevel field in the Subscriber record indicates the subscriber's 
willingness to accept the > insertion <if coram^ 

to defray subscription costs. > A ChargeLevel value of zero indicates that the subscriber 
desires to pay the minimum charge and correspondingly is willing to accept sufficient 
advertising content to achieve that goal. At the other extreme, a ChargeLevel value of 
255 indicates that the subscriber wishes to eliminate ail commercial messages except those 
specifically requested. 

The DataRate field indicates the rate at which iiifornunion can be downloaded to 
the subscriber over die available communications^ 

of the modem used by the subscriber). The DataRate field is initially established from 
infi>nnation supplied by the subscriber when the account is established (at step 203 in Kg. 
2) but is thereafter altered to reflect actual averaged tran^^ 
25 download operation* Siiril^ 

space available for program data in the player store (seen at 109 m Fig. 1). This value is 
initially supplied by the subscriber during accou* initiau^^ 
whenever the utflhy programs executing oh the processor 105 detect less space available, 
and increased whenever the subscriber consents to the allocation of more available space 
whentheuuihyirograms detect thatspace is available aiidthri^ 
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beneficially utilized given the download time available and the subscriber's desired session 
lengths. . • ' - 

Desired session lengths are contained in seven records each of type Compilation 
as defined in the following record definition. 



S. Compilation^ record 

Earliest, Latest: datetime; 
PlayMinutes, Longterm: Integer, 
end; - 



10 



is 



20 



25 



Each Compilation record describes the download requirements for a specific day 
of the week and contains fields specifying the earliest and latest times of day when 
download can be begun, with the latest download time being at least a predetermined time 
in advance of the session start In this regard, it should be noted that playback and 
download can occur concurrently, wim the Schedule Table being downloaded first, the 
NewCatalog Table being downloaded second, program segments specified in the Schedule 
Table wMchhave not previously been downloaded being transferred third On the order of 
the expected presentation as stated in the Sequence Table), with program segments 
selected by the subscriber for future sessions being downloaded last as download time 
permits. In accordance with the invention, it is desirable to download the equivalent of 
a foil session's programing in addition to uwcurramV scheduled session program^ 
thavin the evert ofatem^ programming will be 

nonetheless be available: In installations which utilize download information to a 
removable media cartridge or a transportable player which is then played back in an 
automobile or elsewhere, and hence disconnected from the data link to the host, h will of 
course be necessary to complete the download prior to the disconnection, meaning that 
the Latest field in the compilation record should be a time which is in advance of the 
earliest expected session start time by a duration equal to the maximum expected 
download time. Because the subscriber may wish to use different download timing on 
different days of the week, a separate compilation record exists for each day. 
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The compilation record farther specifies the expected duration of the playback 
sesaMfothatdayusmgthev The variable Longtenn indicates the 

maxhnum duration in which extended play may be requirecL For example, a commuter 
who sometimes experiences long traffic delays on Mondays and Fridays may specify that 
an extra hour of extended programming should be provided for those days. Such 
extended programming is pretty consists of non^ 
be stored for future use as needed by the player. 

Notethatthe compilation records noted above are iised by me server to optimBe 
the content of the recommended program schedule and not to initiate actual downloads 
totheplayer. As contemplated by ihemvention, me player i^ 

bysendingdownloadiwiueststothese^ Nonetheless, the server can transmit to the 
cfiemplayeraninrtc^ ^ 
this way, the load imposed on the server can be spread over time to avoid delays. 

Program segments which are of interest to the user and which should be included 
meimerthe Schedule Table 307 or the Catalog Table 308 maybe automatically identified 
by the following mechanisms: . 

a. the subject matter codes (Interests, TopChoices and ChoiceCounts) for a 
given subscriber for whom the Schedule Table 307 and Catalog Table 308 are 
being prepared may be compared with the subject matter contained in the 
Program_Segment record's Subject for each subject category descrip^ 
eachmdividual|jrogramdesaiption Note that the Program_Segment record 
~ .forasubject category d^sci^onmayi(Jentify related 

an indication that a subscriber is interested m a paiticular category may be 
used to identify that category, any related category, and any program which 
specifies that category in its Prognim_Seg«nent record. A weighting value 
may be calculated to indicate the extent to wW<» we subscrfter's stat^ 
interests match a given program or calegoiy of programs. Programs to which 
high weighting values are assigned are placed m the Schedule Table if the 
usage log data does not indicate the subscriber has already played that 
; program, whereas the remaining programs ha^ 

than a predetennined threshold are placed in the Catalog Table 308. The 
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duration of the programs specified in the Schedule file 307 is governed by the 
scheduled session lengths, communications throughput, and client storage 
capacity values contained in the DataRate, Capacity and WeekDays fields of 
the Subscriber record, 
b. The attributes of the subscriber (birthdate, sex, marital status, and household 
size) specified in the Subscriber record may be matched against the 
corresponding descriptions contained in the subject and program 
Program_Segment records (youngest, oldest, male, female, houselqw, 
househigh) to identify programs and categories of programs likely to be of 
interest to a subscriber having those attributes. An advertiser-supplied 
function defining this relationship is specified by the DemographicMatch 
functioned field of the Advertiser record, as discussed below. 

a. The tost server may advantageously use an optimization technique such 
as linear programming to complete the segment selection process. The 
optimizer will take into account the Subscriber's time constraints, cost 
constraints, and subject preferences. The time constraints used in the 
optimization are: the playing time available for the current day at the 
player, the download time available, the percentage of segments usually 
skipped by the Subscriber. The cost constraints are Subscriber 
GhargeLevel and the accumulated value of individual advertising 
segments. The subject preferences are based on the user's expressly stated 

m # . interests and others interests inferred from the user's playing selections, as 
noted earlier. Each segment resident in the database at the time of 
download is evaluated against the constraints and the optimizer thus 
chooses a set of segments which is best for the subscriber at that time. 

b. The weighting value computed for a segment in the database inay also be 
advantageously varied in accordance with the age of the segment; that is, 
segments will decline in value as they age with the rate of decline being 
depend on the Timeliness attribute stored in the Program_Segment record. 
If the subscriber misses a download for a given day, the timeliness factor 
will aDow the host server to compensate for the lost listening opportunity . 
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by adding articles from prior days which are still of interest to the 
Subscriber. 



Targeted Advertising 

In order to identify and insert advertising program segments into the Schedule 
Table 307, the preferred ernbodiment of the invention utilizes additional information which 
describes each advertisement to be placed before subscribers. This information is placed 
in an Advertisement record having the structure defined earlier and held in the 
Advertisments Table 311. The ProgramlD field of the AaVertisemert record identifies 
a Program.Segment record (described earner) which describes the content of the 
advertisement itself The remainder of the Advertisement record contains additional 
information used to control the manner in which the identified advertising program 
segment is selected for insertion into the programming supplied to subscribers. 

The AccountNo field of the Advertisemert record 
the advertisement which is typically the same as, but not necessarily the same as, the entity 
specified in the Provider© field of the PrtgramJSegment record tor advertising segment. 
, The Subjects and Imp^^ 
bythePiograiiuTJ^ 

for subscribers to indicate their interest and may be used to produce a numerical value 
InteresfMatch indicative of the extern to which a given adverts 
to the interests of a particular subscriber. The following algorithm, expressed as a 
.functton in Pascal, returns an integer value, which may be employed to derive the 
InterestMatch value indicating the degree to which any program segment matches the 
interests' of a given subscriber: 

faictionlnterestM^ subscriber; PSfc prognuh_segment): integer, 
vart integer; 

InterestCount: integer, 

ChoiceCount: integer, 



InterestCount:=0; 
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ChoiceCount:=0; 
forl:=0to 15 do 
if PSR.subjects(I) > 0 then 
, forj:=0tol5do. 
begin 

if SKInterests[j] = PSRSubjectsfT) then 

inc(InterestCount, PSRimportancefr)); 
if SR.TopChoicesO] =PSR.Subjects[I] then 

inc(ChoiceCount8X20-j)*PSR.Importance[I]); 

end 
eke break; 

return(InterestCount + (ChoiceCounts div 10); 
end; { InterestMatch function } 

The foregoing function identifies all of the Subjects codes specified by the 
program_segment record for a program segment (including a segment specified the 
ProgramID value of the Advertisement record for that advertisement) which also match 
a subject matter code in which the subscriber described by the Subscriber record SR has 
expressly stated an interest, or has shown an interest base on programs actually played. 
In each case where a match was found, the Interestjvfatch value is increased by an 
amount related to both the weight given to the category in advertising program's 
Importance array and the level of interest indicated for the subscriber. Note the 
InterestMatch function described above can be used to generate a numerical indication of 
the degree to which a given subscriber may have an interest in any program segment, 
whether that segment contains advertising, entertainment, news, or other content. In the 
case of advertising program segment however, the Subject and Importance values are 
assigned by the advertiser in order to define the interests held by target subscriber to 
whom me advertiser wished to direct the advertisement. 

to addition to the InterestMatch value determined above, weight may be given to 
the subscriber's personal characteristics using a similar weighting function specified th the 
functionjd DemographicMatch which, like interest match, returns a value based on an 
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advertiser specified relatiionship based on the subscriber's" personal characteristics (age, 
sex, marital status, size of household, etc.) as previously noted. The value 
DemographicWeight may be used to specify the relative importance of demographic 
values derived by the the DemographicMatch function and the value returned by 
InterestMatch. 

All advertisements scheduled for a given subscriber may then be prioritized based 
on the resulting calculated weight assigned to each advertisement by matching algorithms 
which compare the characteristics of the subscriber with the makeup of the target 
audience defined by the fields of the Advertisement record, these advertisements are then 
preferably inserted into the programming Sequence with the advertisement having the 
highest weight being scheduled to occur first in the sequence, thereby insuring that the 
best fitting advertisements are included in the programming and most likeh/ to be played 
by the subscriber. 

Controlling the Quantity of Advertising Delivered 

The rate at which advertising is actually inserted by the player is controlled by the 
OiargeLevel value in the Subscriber record for each subscriber. The ChargeLevel value 
(a number from 0-255) indicates the rate at which a subscriber is willing to accept 
advertisements. An advertisement duration count variable (not shown) maintained by the 
player 103 accumulates the total duration of actually played advertising while a program 
duration count variable accumulates the total duration of actually played programming. 
An integer division of these to duration count values indicates the proportion of time 
being devoted to advertising. If this proportion falls below a threshold value determined 
by the value of ChargeLevel, additional advertising is inserted between program segments 
until the desired proportion is again reached. In this way, advertising skipped by a 
subscriber will be replaced later by different advertising to yield the proper proportion of 
programming to advertising, thereby achieving the subscription charge rate requested by 
the user. , 

The Schedule 307 downloaded to the player, and the associated programming, 
announcement and advertising segments sufficient to provide a complete program 
sequence with adequate advertising to meet the preference of the subscriber, creates total 
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program content longer than the expected playing time indicated by the PlayMinutes 
variable of the days Compilation record. As a consequence, the player builds a collection 
of program and advertising segments which can be played in the future and need not be 
downloaded. IWoading of actual program segments therefore preferably oc^ 
request of the player which scans the Schedule for program and advertising segments not 
already available and issues a request for the needed segments using the URLs contained 
in the players catalog of ProgramJSegment records. In addition, as noted earlier, the 
subscriber has the opportunity to review the local catalog for particular program segments 
of interest which can be placed in the next day's schedule (and downloaded then at the 
request of the player if not already resident). The catalog of available items is 
supplemented by the NewCatalog Table hems downloaded from the server as library items 
are identified whose makeup matches that of the subscriber and should be included, either 
iinrnediatery in the days Schedule Table, or made available by inclusion in the downloaded 
NewCatalog Table alone. 

Accounting Functions 

The preferred embodiment of the invention processes the usage log data created 
during the playback session as described in connection with Fig. 3 to produce a variety of 
accounting and analysis reports and billing functions! 

Each advertising, announcement and program segment played on the player 
creates a UsageRecord stored as an record in the Usage Log Table having the following 
content: . 

UsageRecord = record 

Subscriber: integer; ' . 
ProgramlD: integer, 
Start: datetime; 
Volume: Integer, .. 
PlayingSpeed: Integer, 

end; 
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The Subscriber field contitfns the AccountNo of the subscriber which used the 

If the value ofProgramlD is negative, the record indicates a tailed hyperlink attempt and 
thern^rr^ispc^tothelUc,^ 

^vM^tcBWtotetoMb^totepU^. IntheUs.geRecord.the 
Start field contains the starting time of day (to the nearest second), the Volume field 
contain. . value tW, the level « which the volume was played, and the 
^^^0^^,.^^^^ A negatrW playing speed. 

that onty highlight passages were being played. 

As noted eariier, ^VU&mrtk-fm^tonuWtoSitbKaBnmi 
Add TopChoices by fir* bunding an order* Bs. of sut^ ™mer ctfegories and the 
correrpotaiing counts of the number of time, each w« pUyed „ the session 

*^bytteUs^U, g T.ble. These counts are men used to increase the existing 
ChotceComtttettasubjectrnatt™^ ^ 
TcfOKtoandaoiceC^ 

•"mberofpbys. To insure th^^.n^c^,,^^^^^ 
"to the list, the lowest five old entiies are disc^rf each time ifnecessary to n»to room 
for, the five most frequency pUyed rattgori „ m the current us^ log wHd. were not 
alre^onmeh*. ^Tc v C^^ ux ^ c ^ miLd ^^^ 
of subscriber subject matter preferences which is cornmuoosly modified automatically 
'^ut requiring attenUon from fte subscriber. 

Subscriber Wring is based on the .ccunail^ molim tf 
^M"«ubscrib«rwim^ 

•"""criber. ^mmmm^t^^m^^,,^^^^ 

wage log which indicates the program heard, the duration of each, ar«i the cost (or 
cmte) attrihrtable to that progmm segment In. rmtelua. value specified in the 
Prognuu.Segment record for each hem spedBed in the UsageRecord's ProgramTD i, 
"uUuphed times the segment nunrtion (detemmed by subtracting the start time of the 
segment fixm, the star, time of the next segment specified in the next UsageRecord) The 
TmielUte is . sirp^ed irrreger, ^ 
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advertise) and positive values being intfcatwe of charges for prograniining. Notefhat 
each program segment and advertising segment can have a different rate, allowing the 
system to accommodate charging rates that reflect different programming costs. 

Such costs frequently are affected by the royalty rates charged by content 
providersasweUastheexterttowMAcostsare In accordance 

with the invention, each UsageRecord may also be posted into the Content Providers 
Table 3 1 5 which maintains royalty payment records for amounts.diie to content providers. 
As in the case of subscriber billing, the processing of UsageRecbrds allows the 
embodiment shown in Fig. 4 to provide detailed information to content providers, 
identifyingmee^ Content 
providers can also be provided with demographic statistics identifying the characteristics 
of the subscribers who chose to play the content provided, as well as an identification of 
the extent to which program segments were skipped while in progress, tending to identify 
programs which were had continuing appeal during the session and those that did not. 

Similarly, advertisers can obtain detailed billing records indicating the precise 
extent to which advertising was actually presented, and paying only for advertising known 
to have been effectively delivered. In addition, demographic data can be provided to 
advertisers indicating the makeup of persons who played the advertising, as well as the 
demographic characteristics of those who did not, in order to better target future 
advertising. 

Finally, the UsageRecords are processed to postuse data into the Programs Table, 
modifying the Plays and TotalTime fields of the Program_Segment records to reflect the 
extent to which programming materials are actually presented. This information, as well 
as the demographic statistical information indicating which classes of customers are 
listeningtowhich(W^ 

offered programming wWch best fits tb^ 

Program Format and Organization 

The programs which reside in the program database 303 seen in Fig. 4 are 
preferably formatted in accordance wim a stands^ structure to 
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sequence of program segments defined by the selections file 35 1, and to make it possible 
to perform jumps to different predetennined locations in the program sequence. 

As previously noted, the program database 3 03 may include, for a given program 
segment, a recorded audio imationa^ ^ 
tra^doi*^ 

While these narratives «^ be listened torn a Imear sequence, h 
to selectively access individual program segments by organizing the overall program 
compilation into a hierarchical structure in whichf - 4 
; 1. ^«^e^er,thepr^ 

are described in a catalog and associated with descriptors of various kinds 
aUowingthecbntemofme^ 

subscriber, both through express selections made by the subscriber and by 
selections (or suggestions) made autornaticaOy by matching the subscribers 
known preferences and interests against descriptors which characterize the 
programs segments, as previously described. 

2. The resulting program compilation is then divided into components each 
havingafc*mnir& OT ^ 

by a dynamic selection mechanism which is operative during the fastening 
session. 

3. Agivenprogramsegrnen^ 

selected automatically or expressly by the user as being of interest as 
Pro^descr^ 

segments to form a sequenced associated segments here called a "subject," 
fonning a subsection of the overall cornpilatioa A "subject" collection of 
program segments may (but need not) directly correspond to tte named 
subjectmatter categoAa utilized to spedfy subscriber's preferences as noted 
earlier. A "subject" collection begins with or is preceded in the scheduled 
program sequence by a spoken announce of the subject, giving 
; ^°PP OI ^toskipiminea>tety 

of the program segments comprising that subject 
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As a consequence, by the simple expedient of skipping from subject 
announcement to subject announcement, a user can locate a particular subject 
of interest. For example, if a given program compilation as defined by the 
Selections file (having the format illustrated at 35 1 in Fig. 5) contains one hour 
of programming divided into 8 different subjects collections, the user can 
quiddy locate a subject of interest by skipping from subject announcement to 
subject announcement until a subject of interest is announced, at which time 
the player is allowed to proceed to the next level in the hierarchy, a "topic" 
announcement for the first program segment in that subject collection. 

4. Each program segment begins with a <c topic" announcement which consists of 
a brie£. summary description of the content of the program segment to follow. 
Again, at this level, if the user upon hearing the topic announcement elects to 
skip that program segment, the player automatically advances to the entry 
point preceding the next topic announcement. In this way, within a given 
subject, the user can skip from topic to topic to select only the program 
segments of interest. 

5. Following the topic announcement, if the program segment consists of 
narrative text, such as a news program, the narrative is presented in a 
sequence of paragraphs, with the first paragraph providing an overview 
summary of the content of the program segment (topic) and the succeeding 
paragraphs providing increasing levels of detail. The narrative is thus 
presented in a fashion not unlike that followed in news stories written by 
journalists for print publication, but with more dependable rigor, recognizing 
that the listener presented with a one-dimensional audio presentation must 
necessarily depend on the consistent adhwence to the subject, topic, summary 
paragraph, and increasing detail sequence to substitute for the random access 
provided by two-dimensional presentation of headlined newsprint articles. 

6. Finally, within paragraphs, the sentences should be carefully organized with 
leading topic sentences, again giving the listener a preview of what is coming 
next in the sequence to enable that material to be skipped if it is hot of interest. 
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By way of example, a program compilation for a given subscriber might 
illustratively consist of seven subjects: world news, national news, local news, computer 
trade news, email and voice mail messages, country music classical music, and the listener 
may skip from subject announcement to subject announcement to readily locate the 
beginning of any one of the six subjects. The four "news" subjects each consist of a 
collection of structured program segments, each of which begins with a subject 
announcement, again allowing the user to skip from subject to subject, listening to only 
.those which are found to be of interest 

Shmlarly, the music selections ("topics") within each of the two music subjects, 
"country music" and^dasfflcdtrraac,'' are prec^wmSabn^amipuncement identifying 
the musical selection which follows, allowing the user to quickly skip from announcement 
to announcement until a desired selection is found. Because many listeners prefer music 
without announcements, the subscriber may request that the announcements be suppressed 
during continuous play and/or that the beginning of each musical segment be played 
mstead of identifying am^ 

locate the next selection to be played. To simplify the player controls, the subscriber is 
IJreferaMy selects the extent to which narrative music identification announcements are to 
be played at step 21 1 seen in Fig. 2, at the same time me user is given the opportunity to 
edit the downloaded program sequence. 

20 Flay Highlights Mode 

To further facilitate rapid skunrning, the player may be adapted to support 
playbackmwliatishe^ Just as a student often uses 

a inarker to h|ghl^ importam 

narrative may be tagged as highlights such that, when the user places the player in a "play 
highlights': mode, the player automatically skips from highlighted passage to highlighted 
passage, greatly increasing the speed of imsseatation, but allowing the user to revert to 
normalry play mode whenever a Mghlighted passage attracts the users interest for more 
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Kghlighted passages maybeadvamageousryideimlfi 
relative byte locations (integer offsets from the beginning of the program segment) which 
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form part of the selections file 351 and which specify the start and end of each highlighted 
passage. The player, when placed in the "play highlights" mode, then plays only those 
passages identified as highlighted portions of the program segment file. 

Hyperlink Jumps 

In addition, the structured program files may advantageously contain, where 
appropriate, "hyperlink" passages, which may take the form of announced cross references 
to other materials, or sentences or phrases which describe related information contained 
- elsewhere in the download compilation but which do not Mow immediately in the 
sequence. In order to alert the listens- to the fact that a sentence or passage is a hyperlink 
to other information which is out of the normal playback sequence, an audible cue may 
advantageously proceed, accompany, or immediately Mow the passage in the normal 
playback which identifies the character of the hyperlinked material. Using the 
terminology typically employed to described hypertext, the normal programming 
sequence includes "anchor" passages which are identified by an audible cue signal of some 
type and are further associated with a reference to hyperlinked material to which the 
playback may jump upon the listener's request. Hyperlinked material, like all other 
programming, is advantageously preceded with a topic description and, if the hyperlinked 
material is a iiamrave, it should begin with a summary paragraph, Mowed by increasing 
detail. 

A hyperlink may be directed to a program segment which is not present in the 
current selections fist In that case, the Link variable contains a negative number to 
distmguish it from references to a particular Sdectionjtecord, and is interpreted as the 
negative of aPiogramlD number. If the referenced Program© is available in the player's 
mass storage system, it may be fetched an played and, upon its conclusion, an automatic 
retumis made to the original sequence. If the referenced PrograrnlD does not refer to a 
locally stored record, the listener is informed that h is currently unavailable, but will be 
included in the next download for the next session 

In addition to having means for accepting a user commajtd to execute a junip to 
the hypertext material, the player also advantageously includes a mechanism (special key 
or voice command response) which, when activated, causes a "return" to be made to the 
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playing sequence at the point of the original anchor from which the Jiyperlink was 
performed. In this way, a listener may listen, to as much or as little of the linked 
information as desired, retaining the ability to return to the original Just as computer 
subroira^iiiaybeiu^ 
«nechanis!Ti,ahype^ 

with the listener retaining the ab% to exe(^ a Wee sequence of return 
playing sequence at the point of the first Iryperlink calL 

To control subject and topic skipping, as well as hyperlink jumps, the selections 
file seen generalry 81301 mFu> 4piefi^ 

having the structure defined by the following Pascal record definition: 



type SelectionRecord = record 
LocType: Char, 
Location: Integer; 

end; 



IS 



where LocType is a single byte character having the values and meanings shown in the 
following table:. 
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LocTvpp. 


Meaning 




Subject Announcement 




Topic Aiuiouncement 




Programming content segment 




Advertising segment 




Glue (aimouncement) segment 


"it 


Highlight start offset 




Highlight end offset 


"A" 


Anchor start offset 


"M" 


Bookmaiked anchor start 


"B" 


Anchor end offset 


«L" 


Linked segment 


"R" 


Rewind to identified location 


apt 


Image identification 




Image display start offset 
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Image display end offset 
"C" Accept comment 

"V" Accept value designation 

"X" Accept list termination 

"Y" Accept "Yes" /"No" 



As seen in the table, highlight passages are specified by two Selectioh.Records, 
an "H" marking the beginning and an "B" record marking the end of the highlight passage. 
The Location field in each record contains the byte bffeet from the begbning.of the 
current program segment whose identity is specified by the last preceding "P" 
Selection_Record which contains the ProgramID of the program segment in which the 
highlight passage occurs. "Q" advertising segments and announcements segments 
behave like regular programrning content segments, but are uniquely identified to enable 
the player to skip over, or skip to, advertising and glue segments when appropriate. In 
the "play highlights" mode, the player scans the selections file and plays the program 
segments for each subject and topic announcements but plays only those portions of an 
identified program segment which are specified as Wghiight passages or as anchor 
passages tor hyperlinks.. 

It is desirable to further provide a mechanism for subdividing narrative 
programming segments into subparts (e.g. paragraphs). Lowercase LocType values "s", 
«t"> «p„ « q „ md "gr. are ^ to subdivide subjects, topics, programming, advertising and 
ghie segments respectively. The lowercase Loctype records provide the markers needed 
to implement subdivision skipping, as previously discussed, to enable forward and 
backward navigation within longer program segments, and further provides passage 
identifiers which may be used to better synchromze the audo and ^ 
25 ' presentation of longer passages. 

An T Selection_Record contains an integer identification of an image file which 
is downloaded and stored using a filename found in an image filename table indexed by 
the iniage identification number. This indirect access to the image files eliminates the 
necessity cfston^me.file^ TheT imagefile 

identification recdrds.inmediatety^ «r record which specifies the oftset location 
from the start of the compressed audio file where, the image display begins. In normal 
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"slide show" presentations, the current image display continues until the position indicated 

**«m~tt^ M ^^to^m.»*^,am* The 

^ieconltyr«isorovidedtoinaTcateti^^ 

Each anchor passage for a hyperlink is specified by three selection records: an "A" 
record indicating tie start of the anchor passage, an «B" record indicating the end of the 
anchorpassage, ^V^co^^f^^ k ^^^ m ^ m 
to which a jump is made if the user requests *juinp to tte^ 

As'discussed in more detail later in connection with Fig. 7 of the drawings, the 
position and identification of highlighted passages, hypertext links and synchronized 
images may be conveniently expressed using conventional hypertext markup language to 
tag the text of the narrative to being presented in the interactive multimedia format 
contemplated by this aspect of the invention. 

The start of bootanarked passages a^^ 
" H " ^ Dowed ^ reccrd to identify the end of the bookmarked passage. If a voice 
annotation is added, the player places it in its own program segment wWch is identified 
wrmanegativeProgramlDmthefoUowin^ The presence of the annotation 

may then be made known to the listener during subsequent playback of the marked 
paiaagebymeansofadistinctive^^ 

**Mm^um 9 &m«m^V& a * tlM . Note that bookmarked 
passages and annotations are noted both in the usage log file, as discussed earlier in 
connection witji FigJ at 2M and 281; but also their presence is also recorded in the 
SdectionsfiJe 351 by inserting "M",T, and ftf annotations exist) V records, malting 
rt possible to mmediateiy replay annotations or return to replay bookmarked passages. 

Annotations differ from "comments .» Like an annotation, a comment is also 
stored in its own program segment, but a comment operates as a public or private 
messagegenerated by theuser ai»d c^ 

sperial interest group, (2) ori « mator of a P ro «nun segment, which may be the author 
ofeamerconmient,(3)thesysto 

anoteforfixturereference. Wlifle bom comments and annotations may be createdatthe • 
request of the user at any point during a playing program segment using the "Accept" 
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command (see 263-264 in Fig. 3), the user may be prompted by a pre-recorded request 
foracbinment, or other user input, with the prompting request being placed at any point 
in a playing program segment, typically after an audio prompt which explains the nature 
of the information being requested. 

Requests for information from the user preferably take one of three forms which 
are implemented by the records in the schedule file identified by the LocType codes "C 
.^V.Tr and-V. 

A "C" record causes the player to temporarily pause the playback and record a 
voice response from the user which may be arbftrarfly long and which is uploaded to the 
server 101 to form a new program segment in the manner to be described under the 
heading "Comment Handling. 

A "Y" record pauses the playback and awaits a tt YesT or "No" response from the 
user which is then recorded in the usage log. The yes/no response request allows a 
program provider to obtain response data from subscribers 

When simple "yes" /"no" answers are inadequate, a series of T records may be 
used to identify a set of prompt values from which the user may select, with the end of the 
list being indicated by a "X" record. The narrative of a program segment might, for 
example, proceed as follows: « We would like to know which of the following four ice 
cream flavors is your fevorite. Say the word "YES" promptly when your fiivorite is 
mentioned. Y chocolate Y vanilla Y pistachio Y peach E". In the ocample, the Y 
characters indicate the position of the start of each prompted choice and the E character 
indicates the end. If no affirmative voice response has been accepted by the time in the 
playback the position indicated by the E selection record, the player returns to the 
pc^tionsindicatedbyfestrf^ Whenavalid 
response is received, a response value is written into the usage log indicating the ordinal 
IHJsitionof the selected response: Given the prompts above, for example, if the user says 
"YES" after the "chocolate" prompt, the response value 1 is written to the usage log, if 
the user selects Vanilla' a 2 is written, and so on. 
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The Selections FOe 

— — b pbyed. ft. P%* ^o, ^ to fc ^ 

selection, can be readily found. 

If the user issues a skip command durine the hnrfv „f . „ , . 

„. .• mg me Ood y of a program selection: that is 
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the next "S" subject or 'T ? topic record, skipping the remainder of the program selection. 
Thus, the user can quickly resume slamming on the subject and topic level at any time. 

The user may also issue a 'Back" command at any time. Back commands work 
Uke Skip commands at the subdivision, subject and topic level. If a Back command is 
issued when a subject is being played, the player scans backward to the previous subject 
announcement, which is then played. If the user issues a back command when a topic 
announcement is being played, the player scans backward to find the previous subject or 
topic announcement, which is then played. If the player issues a Back command during 
the playing of a programming segment, the player returns to the beginning of the prior 
subdivision (if any) or the prior topic announcement for the current program segment, 
thus enabling the user to easily "replay'* a current segment from the beginning if desired. 
As indie case of forward skip commands (SKIP TOPIC and a SKIP SUBJECT), BACK 
TOPIC and BACK SUBJECT commands can be made available to.the user such that 
backward navigation from subdivision to subdivision occurs using BACK TOPIC whereas 
the issuance of a BACK SUBJECT command always returns the playback point to the 
beginning of the prior subject matter description. 

The manner in which a "Back" command is handled as described above is subject 
on additional variation: The position at which each skip forward command is issued may 
be advantageously saved so that, upon the issuance of a subsequent Back command, the 
user may return to the position at which the skip forward position was issued. This allows 
the user, for example, to skip forward to listen to the nest program announcement, and 
then use the Back command to return to the point from which the skip forward command 
was issued. These position indications may be saved as markers in a bi-directional bst, 
allowing the user to skip forward or backward to any position from which a prior jump 
was made. 

When the player is first activated, CurrentPlayissetto 1 tobeginpUy whhthe 
first topic announcement specified by the ProgramlD 357. The end of the selections file 
351 is marked with an "R" SdectionRecord 380 which contains the location value 1. 
When the player encounters this record, it resets the CurrentPlay register to 1, and the 
playing sequence begins again. This arrangement creates, in effect, an endless loop, 
allowing the user to skip forward in circular fashion through the entire program selection 
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to locate desired programming, regardless of where the CurrentPlay register is set. When 
the player is given a forther back command after the beginning of the file is reached, the 
backward scanning process finds the record 382, another "R" rewind record which 
contains the location of the last "S" subject Sdectionjtecord. In this way, the selection 
file 351 behaves as a bi-directional endless loop. 

Hyperlinks are implemented by means of anchor passage identifiers] the "A" and 
"B" Selection records which respectively identify the anchor passage, and a "LT link 
idei^wMchhcMsthelocation of a subject, topic or highlight Selection_Record. The 
tt A^ and"B" selection records enable the player to add an audio cue (such as a tone, low- 
level chime, or the like) to the beginning, end, or during any passage in any program 
selection. Whenever the user issues a "Go" command (seen at 265 in Kg. 3), the player 
will execute a hyperlink jump to the location indicated by the last "L" record in the 
selection file.. When the jump is made, the location in the «L» record is inserted into the 
QmenfPlay register 353 after the previous contents of the CurrentPlay register are saved 
m(pushed into) a zero-based stack 390 at the stack cell location specified by the contents 
of a StackPtr register 392, which is then incremented. Whenever the listener issues a 
"Return" command, the previously pushed selection file record location is popped from 
the stack 390 and returned to the CurrentPlay register 353, and the StackPtr register 392 
is decremented. A <i Retum" cmmand issued when StackPtr- zero On*catii« an empty 
stack) produces no effect 

The hyperlink capability described above may be used to implement a program 
menuofthe type described earlier in connection whh Fig. 3: A menu program segment 
inay be mchided m the program con^ 

of subjects or topics, each description being the anchor portion of a hyperlink to the 
corresponding subject or topic' 

Although hyperlinks to subjects and topics are typical, it should be noted that the 
arrangement shown in Fig. 5 can be used to link iiny passage to the begihn^ 
any highlighted passage or to the beginning or end of any anchor passage simply by 
placing the selection file location of that target in the "L" link Selectioh_Record forming 
that link. 



54 



WO!W «"' PCTYUS98/03444 

& its preferred form, the individual program segments are stored in a random 
access mass storage system permitting program segments to be physically stored in an 
order unrelated to the actual dynamic sequence in which those segments are played. 
Forward and backward skiraming, highligte 

be implemented without any noticeable delay being apparent to the user, unlike the delays 
which are experienced in forward and rewind operations on a physical tape player, or even 
the briefer delays experienced upon selecting a different track of a compact disk music 
album. 

As contemplated by the invention, the -integration of structured audio 
announcements and content, as will as cross-referenciitt» and indexing information in the 
audio program compilation, allows the player to be much more interactive than a simple 
tape recorder. The user has the ability to browse and skip through the audio program in 
a very active way, without any requirement to look at a visible display of the program 
content. The ability to navigate the program using only audio prompts and/or small 
number of buttons for a user interface make the playback system which utilizes these 
features of the invention particularly attractive for use by automobile drivers, who can 
select their program content much more effectively and with less drive distraction than 
currently possible with a conventional automobile radio, tape or CD player. 

Program Production 

Fuj. 6 shows the method followed to produce program content which is structured 
in accordance with the invention to ferilitate interactive program selection. The first step 
in program production is to build a structured database of 'articles' which are candidates 
for inclusion in individual subscriber compilations. 

The authoring system seen in Fig. 6 scans a wide range of data sources 401 for 
poteim^ .coiitentasmdicatedat403. Examples of data sources might be news service 
wire feeds or newsgroups on the Internet. The authoring system subdivides the accessed 
program data into program segments (topics) and indexes each segment by subject area 
at 405. In the case of text data, this indexing may be done automatically by parsing the 
text into words and building a conventional inverted file word index to the program 
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segments. In the case of audio programing, a text transcript may be prepared using 
conventional speech recognition mechanisms to for a transcript, and the transcript may 
then be indexed by the terms used. Alternatively, human indexers may produce 
desert w<>rasandi^ segment, and these 

descriptors may be used to index those segments, 
i^meirdexirs^ 

the each program segment's index data at 407 with system wide selection criteria in a 
systemdatar^4Wtop^^ 

those programs which of potential relevance to one W more of the established subject 
matter categories off^ Accordingly, the system filter database 409 may 

take the form of a set of words (descriptors) of known relevance associated with each of 
the subject matter categories in the catalog. The comparison functional 407 scans the 
words in each candidate program segments to form a weighting value indicating the 
*requency(<ie^^ Program segments 

whose content produces a high weighting value with respect to any category are 
autoniatically associated with that category and retained for further processing as 
indicated at 408, while program segments producing no weighting values greater than a 
predetenmned minimum may be completely discarded at this stage, as indicated at 41 1, 
since their content does not indicate a sufficient likelihood of being of interest to a 
sufficient number of subscribers. Marginal program segments may be returned to the 
source library 40 1 for possible later use in the evem mat user preferences change. 

■i Each article which passes the system filter at 408 is processed as shown at 414 in 
Fig. 6. Asnotedeadier,^ 

a transcript for those segments which consist, in their original form, of voice narration. 
Hiis step may be automated using speech recognition or manually by keyboarding to 
create the needed transcripts. 

As indicated at 425, when the original material consisted of infoirnation m text 
form, a human reviewer verifies that the program content is in feet relevant to the subj ect 

adds additional subject matter categories that iiiay have been overlooked by the automated 
process. Asa resuh of this ^ 
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program segment is associated with one or more subject matter categories which are 
encoded into a standard form in the Subjects array of the ProgramJSegment record 
described earlier in connection with Fig. 4. These subject codes are further assigned an 
importance value in the Importance array (which is parallel to the Subjects array) by the 
s human author. Note that the order in which subjects codes are placed in the Subjects 
array may be used to indicate the relative relevance of the subjects to the program 
segment; that is, the most relevant subject is identified in Subjects[0], the next most 
relevant subject is identified in Subjects[l], and so on. Each program is typically placed 
in the output sequence in accordance with the at Subject[Oi, the subject to which the' 
10 program segment is most relevant:' 

In addition, the human review may compose a narrative cross referencing 
description of some or all of the program segments which were secondarily relevant to a 
given category, that is, program segments which were most relevant to another category 
but also relevant to the given category. This cross-referencing description may 
advantageously utilize the hyperlink capability 

is listening to the description of any related program segment, that related segment may 
be listened to simply by issuing a Go command to jump to the linked article, and later 
issuing a Return command to resume the playback at the original point. 

The body of the program segment is then organized by the human reviewer at 
steps 43 1, 433, and 435 seen in Fig. 6 to create an output program segment having the 
desired structure consisting of: 

(1) .a topic statement which is packaged in a separate program segment, 

(2) a leading summary paragraph, 

(3) further content organized into paragraphs of increasing levels of detail, in 
which all unnecessary detail is excluded (that is, longer topics are digested 
into shorter, overview topics, with the full version being made available in 
an alternative, unabridged form which is also made available to the 
listener), 

(4) "' ad(!ing highlight identification to key terms and phrases, arid 

(5) addiiigcross-referen(Mghyperlinto 
if necessary. 
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When the original program segment is a news article or the like which was made 
avadablemtextfo^ 

the text, with the conversion to audio being performed by a human announcer or by 
speechs^^aiterte 

at 436, the human reviewer may cornpoae a new artidewm^ has condensed 

431, add atopic (title) and sumrr^ paragraph previously created andthen,at 

435, add highlighting and hyperlink tags (which take the form of imbedded flags of the 

typeusedmHyperte**^ 

P»g.7). In order to assist the listener m deddmg whether to listen to, or skip agiven 
subject, it is desirablethatthetopicand subject announcements include a statement of the 
pkymgtirr^.particularryforlongerprogr^ In addmon, the playing time is 

recorded in the Program.Segment record for that segment in the field named "Duration" 
as notedeariier. A human announcer then reads the structured text, or it is alternatively 
converted into an audio program segment by speech synthesis, as indicated at 435. 

If desired, the user may request the player to periodically issue a time of day 
announcement. The user ,r»y set a playback pr^ 
durationbetweentim^ ^ ^ ^ m amoa ^ t k 

the last announcement time is recorded. Each time a logical break occurs between 
program segments, the last announcement time is subtracted from the current time and, 
rftiieresuhexceedsthedesired^ 
is issued. 

In addition, at the user's option, the piayer may abo periooMcalry announce the 
duration of the flayed portion of the session eriabling the listener 
programs in order to play others when the actual listening tirnea^ 
time available to play the entire renuming program. 

The player may be programmed to Issue timed messages to the fistener. For 
exainple, a program se^on my mterr^ 

funcbon at a particular time, such as listening to a scheduled radio broadcast 
AHernauvely, the player may be programmed to play identified segments at a particular 
nmeofday, or * a particular time rel^ 
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minutes after the session begins regardless of what has been played before or where the 
player is in the sequence). These programmed interruptions are preferably performed as 
automatic hyperlink, enabling the user to return to the regularly scheduled but interrupted 
programming simply be issuing a "return" command. 

It should be noted that program segments may omit the "original" audio file 
entirely. Instead, the audio may be generated on the user's player using speech synthesis, . 
with tag to speech.conversion of the tagged highlighted materiaU m^^^ 
The text-to-speech technology might be especially useful for specialized subject areas 
. such as weather reports, sports scores, or stock market quotes, or other primarily^ 
informational articles where the content is significantly more important than the form of 
speech. 

The availability of a collateral text file makes it possible to perform scanning 
operations to "find" particular words and phrases in the presentation, and perform a jump 
to that position in the file. Thus, the user may request the player to locate and play the 
next program selection in the sequence to contain the word "patent" and the player, in 
response to that request, performs a serial search through the transcript text associated 
with each program segment until the requested word is found, an a jump then executed 
to resume play at that location. 

Using conventional text indexing techniques, the transcript files of the programs 
specified on the current program schedule, as well as the transcript files of other locally 
stored programming, may accessed by means of an inverted file in which each significant 
word in the playable library is assodatedwim the an mdexmg record for e^ 
of that word, the record containing program segment identifier for the program segment 
including the word and the ofiset(s) within that segment where the word occurs The 
availability of that inverted file allows the ^U>'hm t ^y Am toumt*4* 
luunberoftimetheterm occurs to avoid fruitless ^search* as well as searches which find 
too much, without actually scanning the transcripts. The lability of the program 
identifier permits the player to play for the user an announccmem of categories ^ 
along wimarecitaiionoftheium.berp 

"The term 'cellular' occurs 7 times in [program segment announcement], 3 times in ... " 
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mode facilitates the rapid review of longer presentations by focusing only the central . 
points presented while attowihg more detail to be readily accessed if desired. 

When a given program segment contains recorded original audio, such the newly 
recorded narration of a human reader or an audia recording of a broadcast radio program, 
the file of selection records to be associated with that audio recording file is created by a 
human editor who utilizes suitable audio monitoring and editing equipment to listen to the 
playback of the audio playback file and identify the byte location within that audio file 
where highlight and anchor passages as welt as response prompts which seek user input 
begin and end. hadclmoii,forhyper^^ 

identification of the ^referenced material by specifying the symbolic name of another 
selection record associated with the same or a different program segment to which control 
is to be passed if the hyperlink is executed by the user. A crucial step in the production of 
each segment is the association of byte locations in the audio stream with the records in 
the selection file; This association may be done by a human technician or by automatic 
methods. 

A technician would use a computer with suitable audio playback capabilities and 
software to play the audio stream and to simultaneously display the transcript if it is 
available. The software which plays the audio generates a new record in the segment file 
which contains the current byte location within an audio file whenever the human editor 
pressedakey. The significance of a byte location may teinmcated by pressing a selected 
oneof apluratoyofkeys. Forexample, the technic could generate Subject aiid^ 
records with the correct byte offset simply by pressing the «S "or "T keys at the right 
moment while listening to the aidioprogrm The software^ 
the synchronizing segment record and prompt the techri(^ to associate byte lbcation 
thus identified with a corresponding location in the displayed transcript using a mouse or 
other positional identification means. When no transcript is available, the operator may 
be prompted to enter a topic or subject desciij)tionvk the keyboard. 

The process of associating of audio location with segment records process could . 
be automated by adding additional software to the technicians editing computer. For 
example, as . indicated at 437, speech recognition technology may be employed to 
automatically ide^ when the live speaker changed in an audio stream . The monitoring 
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V* con*** program ^ „ „ 43 , conTressed>t ^ 

program segment data assembled at 41 s . - ■ ^ ™ 

tabtaJT,,*- ««8 m aycon f ^cro SMe fe OTdn8Kllts)ln(Ithese 

wild. * » ' Pro 8 ra °'- ID ■««*«> the byte location of. particular pa*™ 

^^^^^^^^^^ 

Cor^, symbolic names are preferably used to initially ideJI 
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Location field in "L" SeIection_Records. As discussed previously, these offset values are 
either positive values specifying the location within the Selections file of the 
Selection_Records which identifies the link target, or negative ProgramJD values which 
identify program segments not specified by the current Selections file as being part of the 
current program session content 

Comment Handling 

As previously discussed in connection with Figs. 3 arid 5, the apparatus 
contemplated by the invention advantageously includes means for accepting comments, 
yes/no responses, and value selections from a user during a playback session. As 
discussed in more detail below under the heading Refilling Audio Programming with 
HTML," these prompted user input responses are analogous to and can be composed 
using the «NPUT> tag form elements defined for use in standard hypertext markup 
language, where the "C" records in the selection file are analogous to <INPTJT 
TYPE="text"> HTML tags, the "Y" selection file records are analogous to <INPUT 
TYPE="checkbox"> tags, the "V" records are analogous to <3NPUT TYPE="radio"> 
radio button tags. Together these prompt mechanism provide a robust. mechanism for 
prompting the user for and collecting responses of various kinds. 

This mechanism for obtaining prompted responses inay be advantageously 
employed to request information from subscribers. For example, prompted requests may 
be used to obtain program ratings from at least those subscribers who are willing to 
paruapatemtheprog^ Using «y and "B" records, for example, a user 

may be asked to grade programs by various criteria and the resulting data may then be 
used alone or in conjunction with other values to produce a figure of merit for 
progranuning, whereby programs receiving higher ratings can be assigned a higher 
priority. In a similar feshion, willing subscribers may be offered the opportunity to 
volunteer to participate in surveys of various kinds, with the added advantage, that 
personal and preference date already available for each of the participants may be 
coml)medwifothesu^ For example, the tendency to give a 

negative responses on a particular topic may be correlated with the age, sex, geographic 
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location, etc. of the respondents. Subscribers who are participate in the surveys may be 
rewarded by providing reduced subscription rates, free programs, or cash payments. 

As discussed previouslyin connection with Fig. 3 and 263-264, the embodiment 
which described also includes the capability of accepting comments from a subscriber at 
any time during the course of program playback. When such a comment is recorded, it 
is saved as separate file (or other identifiable data) together with the ProgramJD of the 
program commented upon, the byte location within the playing program file where the 
comment or annotation is being made, a Class variable indicating the nature of the record, 
the Class variable being used as the Class variable in the ProgramJSegment record for the 
comment or annotation or comment, and the date and time of day when the comment is 
bengcreated When the comment is created, the user is then requested to specify, either 
by voice response or by a keyboard selection, whether the information to be recorded is 
to be treated as: 

1. An annotation to be appended to the playing program record; or 

2. A comment which is treated as an independent message/program segment. 

The user further indicates the extent to which such an annotation or comment is 
to be made available to others. If designated as being public, annotations become 
available to any other subscriber who subsequently plays the program, at least to the 
extent that a given subscriber indicates that the playback of annotations is desired. Private 
annotations are simply stored in the user's local disk storage are (at 107 in Fig. 1) for 
future reference whereas public annotations are uploaded to the server where they are 
saved as separate files keyed to the original by means of the downloaded selections file for 
those subscribers who desire to hear annotations. 

Comments are designated as being public or private messages! Public comments 
become independently available to all subscribers who have indicated an interest in the 
subject matter category(s) to which the comment relates. By default, a comment is 
assumed to relate to the same categories assigned to the program segment which was 
playing when the comment was produced, but these category codes may be changed by 
the user during the editing session (seen at 217 in Fig. 2). In addition to altering the 
subject matter codes for comments alreaaydic^toeedit^ 
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to the user at step 217 may advantageously include the ability to delete dictated comments 
so that they are not uploaded at all, direct comments, to specific subscribers or email 
addresses, and enter new comments on any designated program segment in the current 
catalog by dictation or keyboarding. 

In order to provide an appropriate program description for longer topics 
whenever a user records a comment have a duration which exceeds a predetermined 
elapsed time, the player 103 performing the recording (at 264 in Kg. 3) produces an audio 
announcement request-that the user dictate a brief summary of the comment which is 
usedtofonnthetopicdesciipuonforme^ In me catalog listing 

provided to subscribers who desire access to comments as well as programs in a particular 
subject matter area, comments are listed in outline form as hems which are subordinate 
to the parent program or comment to which they relate. The CommentOn field found in 
the Program_Segment record for each comment provides me information needed to 
disphymeWerarducaltree. The public comment meclHmism contemphted by this aspect 
of the invention provides a useful facility which enables subscribers to exchange 
iitfonriatioh with each other in special interest groups which function much like the 
UseNet groups on the Internet, but with a conversational ease and informality that audio 
recording makes possible. 

A subscriber can elect the degree to which public comments or annotations are to 
playedbackalongwUhprogran^sortopicsrfsp^ Comments or annotations 

can be excluded entirely, a fink may be imbedded . which may be executed at user request 
to play the comment or annotation at the point in the file where the comment or 
annotation was played, or all comments and annotations may be played immediately 
without first requesting user approval. 

Private comments are not posted to the subject matter categories and are made 
available only to (1) the author of [specified by the Provider© of] the program segment 
being commented upon; (2) the host system, or a host system editor responsible for the 
subject matter area about which the comment is concerned; or (3) some other destination 
specifiedbytheuser. By sending comments to the author, the user can make a direct but 
private response to air/thing contamed ma message or program created by 
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Particular advertisers or other content providers may encourage such comments and offer 
subscriber credits or other incentives to those who are willing to make comments. 

The ability to send comments to the responsible host editor provides a direct 
mechanism by which a subscriber may express satisfaction or dissatisfaction about the 
programming content provided, suggest other progranmiing wMcli would he of interest, 
and the Eke. Moreover, the to-host comment provides a mechanism to assist the editors 
to identify subscribers who may be inappropriately mjetting offensive material to the 
anncyausofothersubsoibera. In addition questiom about the operation of me syst 
may be directed to the host, thereby providing help and customer support to subscribers 
who may need assistance. Finally, the host may provide additional services (fact finding, 
tnuisactionprocessing, and me like) which iwiiMdeav^^ 
subscribers. 

Finally, the ability to direct comments to specific people allows the system to 
provide voice-mail like functions among subscribers. Using speech recognition, dictated 
comments may be translated into text messages that could be sent to anyone having an E- 
maa address or facshmle receiver. Alternatively, the comment could be transmitted as an 
audio file attachment to an E-mail message (e.g. as a RealAudio file). In addition, like 
private annotations, the comment may simply be placed on the user's local disk for future 
reference. 

Conimentsairiaimotatio^ 
unit whh header information designating a CommentON field (the ProgramJD of the 
programj,egmem<^^ 

comment was dictated, the Class field specifying the nature of the comment, and the 
Created date and time stamp. The files containing public and private annotations and 
conimeiits (other thm 

the local storage unit) are uploaded to the host at the same time the usage log is 
transferred, (see 219, Fig. 2). 

Defining Audio Programming with HTML 

Narrative text to be presented in the interactive, multimedia format made possible 
by the present invention may be advantageously expressed in the first instance using 
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essentially conventional hypertext markup language, "HTML". Kg. .7 shows an example 
of the content of a.portiori of an illustrative HTML text file indicated generally at 450 
used to create an audio file seen at 460 and a selections file indicated at 470. 

The HTML file illustrated at 450 uses conventional <0MG> tags to identify image 
files, conventional emphasizing tag pairs <EM> and </EM> to designate highUghted 
passages, and conventional <A > and </A> HTML tag pairs to designate the anchor text 
and link target ofahvpertext link. Utilizing conventional HTML to describe the narrative 
content to be presented in audio form provides several significant advantages,- not the least 
of which are: 

(a) conventional HTML composition software may be used to add the image 
and emphasis tags by means of visual tools which eliminate the need for 
hand-coding on a character level; 

(b) a narrative text version of the audio prograiiuning may be viewed and 
printed, including both the emphasized text and the imbedded images, 
using most popular web browsers; 

(c) existing HTML files may be readily converted into audio, multimedia 
presentations witii little or no HTML editing being required; 

(d) HTML file may be made available from a server in a form which can be 
viewed in the normal way by any web browser yet and alternatively 
presented accordance with the invention in the form of an interactively 
browsable audio program with synchronized images; 

(e) the HTML file may be supplied along with the audio-file as a transcript for 
the audio presentation, and to penmt me audio presentation to be indexed 
and searched; and 

(t) the HTML may be automatically converted into the combination of an 
audio file using conventional speech synthesis techniques to process the 
narrative text with the HTML tags being used to compile a selections file 
which enables the player to interactively browse the audio file using 
highlighted and linked passages,. and to synchronize the image presentation 
with the audio file. 
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*m*D**mBlX<r>, which to specify that the display of JPEG image in the 

specifyinglMGEILElJPGandthelMGSTARTbyte locationin the audio file 460 where 
the display of that image is to begin. This display continues until the next <IMG> tag is 
encountered specifying the IMGFILE2 JPG image which creates the *T and T selection 
recordpairat473. The <IMGQFF> is not standard HTML and hence would be ignored 
by conventional web browsers, but is inserted for recognition by the selections file 
compder which responds by inserting the "K» record at 474 which specifies the point at 
which the current image display should end. 

Immediately thereafter, the phrase "Television and motion pictures" is identified 
as a taghlighted passage by the tag pair <EM> and </EM> seen in the text 450 These 
tags are translated into the «H» and "E" record pairs at 475 in the selections file 470 which 

'^to**^m*.^«i*^ktomaott* As discussed earner in 
conjunction wtthFux 5, ^U^m^M^ml^m^^^^ 

playonlythehighlightedpassages.whenmmen^ A second "H" and **E" 

record pair seen at 476 is produced by the HTML text "<EM>bandwidth«VEM>». 

A conventional HTML hypertext anchor "<A HREF= , ta!£et'>full motion 
video</A>» is processed to produce the three records "A", "B" and V at 478 in the 
selections file which respectively d^^^^^^of^^^ 
passage and the location of a linked informatioa The "HREF='target- portion of the 
HTML specifies the target location in conventional HTML and that symbolic address is 
then translated by the Sections fflecoinpflermto the location^ 

wheh are not part of me currently scheduled programming defined by the selections file 
by a negative number representing the negative of the ProgramID number of the target' 
program segment. 

The HTML forms mechanism may also be used to incorporate requests for user 
*put at predetennined times durbg me playback 0 f program segments. As described 
eaihermconnecnonwtt^^ 
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annotations which are analogous to the <INPUT TYPE="text"> and the <TEXTAREA> 
tagged requests in an HTML form which similarly request the recipient to supply text 
data. In addition, the erabodin^ 

a mechanism for accepting "YESTNO" selections from a user which is analogous the 
HTML form <JNPUT TYPE- 'checkbox^ tag. Similarly, the value choice mechanism 
using "V" selection records provides a radio-button-style mechanism for indicating a 
user's choice from among several options. 

Standard HTML input tags include a Name attribute which can be used as an 
identifier for the data entered. As HTML is translated into an equivalent audio file, the 
tags in the written HTML are translated into records in the selections file which contain 
byte location values specifying when the player should pause the playback and accept the 
user response. The resulting uploaded usage log file (containing responses to radio and 
checkbox input tags) contains the response value together with the original byte location 
value from the selections file which serves the tag identifier. In order to facilitate 
processing of the responses, the HTML to audio conversion process may advantageously 
save a table correlating the Name values in the HTML source with the byte location 
.values. In this way, the input tag Name parameter may be used as a symbolic identifier 
to identify and process response data. 

The HTML input tag Value parameter is conventionally used to supply a default 
response value to besupplied when the user does not supply a different response. Value 
parameters may accordingly be saved for later use and inserted as output data when the 
user does not respond to the request for ir^. (as indicated by 
files of any response data containing the byte location value for the tag not responded to). 
InHie same way, hidden HTML tags may be imbedded in the original HTML and saved 
during the HTML to audio conversion to indicate the correspondence between particular 
byte locations in the audio file and symbolic location names identified by the symbolic 
Name parameter specified in the hidden tag. Such hidden tags may be used, for example, 
to identify the beginning and end of particular passages and may be compared with the 
usage logs to determine the extent to which users exercised their option to skip the 
remainder of a program during the designated passage 
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Conclusion 

It is to be understood that the embodiment of the invention which has been 
described is merely illustrative of one application of the principles of the invention. 
Numerous modifications may be made to the specific structures and functions used in that 
embodiment without departing from the true spirit and scope of the invention. 
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What is Claimed is: 



1. A personalized electronic information delivery system comprising, in combination, 
a host subsystem comprising: 

a file storage server for storing a library of program segments, at least some of 
which include natural language text recorded in digital compressed form, 

means for storing a category description for each of a plurality of subject matter 
categories, 

means for storing* program description of each of said program segments, each 
of said program descriptions including the identification of one or more of said subject 
matter categories to which the described program segment belongs, 

means for storing a subscriber description of each of a plurality of subscribers, 
each of said subscriber descriptions containing information indicative of particular subject 
matter categories designated as being of interest to the described subscriber, 

means for compiling a personalized catalog of suggested program segments for 
a given one of said subscribers, said personalized catalog consisting of category 
descriptions and program descriptions selected in accordance with the subscriber 
description for said given subscriber, 

means for transmitting said personalized catalog upon request, and 

means for traiismitting identified ones of said program segments upon request, 
a data communications pathway, and a client player device located remotely from said file 
storage server, said player device comprising, in combination: 

means for establishing a bkiirectional data transfer connection between said player 
device and said file storage server, 

means for transferring information to ^smd host system for mclusion ma subscriber 
description for a designated subscriber having access to said player device, 

means for transinitting to said host system a request for a personalized catalog 
compiled for said designated subscriber, 

means for receiving the requested catalog from said host subsystem, 
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6. A stem as set forth in claim 5 wherein said subscriber attribute information, 
specifies the age of said subscriber and wherein said program descriptions specify the ages 
of subscribers to whom the described segment may be of interest. 

7. A system as set forth in claim 5 wherein said subscriber attribute information 
specifies the sex of said subscriber and wherein said program descriptions specify the sex 
of subscribers to whom the described segment may be of interest. 

8. A system as set forth in claim 5 wherein said subscriber attribute information 
specifies the marital status of said subscriber and wherein said program descriptions 
specify the marital status of subscribers to whom the described segment may be of 
interest. 

9. A system as set forth in claim 5 wherein said subscriber attribute information 
specifies the geographic location of said subscriber and wherein said program descriptions 
specify the geographic location of subscribers to whom the described segment may be of 
interest. . 

10. A personalized electronic information delivery system as set forth in claim 1 
wherein at least some of said category descriptions further contain information indicative 
of other cross-referenced subject matter categories to which the described category is 
related and wherein said means for compiling said catalog includes means, for including 
said cross-referenced category descriptions in said catalog. 

11. A personalized electronic information delivery system as set forth in claim 1 
wherein said data communications pathway is a digital transmission system and wherein 
said file storage server stores said programs in identified files which may be transmitted 
via said digital transmission system 

12. A personalized electronic information delivery system as set forth in claim 1 1 
wherem each of said program descriptions ^^inchidesmeahsfbr identifying one or more files 
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stored on said file storage server which relate to the program segment described by that 
program description. 

13. A personalized electronic information delivery system as set forth in claim 1 
wherein said host subsystem further comprises: 
ineansfbrre^ 

request for the identification of program segments satisfying criteria specified in said 
search request, 



request. 



^eamforcoinpi^ 

means for transmitting said listing to that subscriber which issued said search 



14- A personalized electronic information delivery system as set forth in claim 1 
"herein said host subsystem further comprises means for compiling a program schedule 
consisting of an ordered sequence of selected ones of said program segments and means 
for transferring said program schedule to said client player via said communications 
pathway, and wherein said client player includes means for reproducing said selected ones 
of said program segments. 



15. A system as set forth in claim 14 wherein said client player includes means for 
reproducing said selected ones of said program segments in the order specified in said 
program schedule. " . - . . 



16. *^assetform mc l^ 
ahen^saidprogramscheMetoform 

program segments in the order specified in said edited schedule 

17. A system as set forth in claim 14 wherein said client player includes means locally 
stonng program segments received from said host subsystem, means for comparing the 
specification of program segments contained in said program schedule with the identity 
of program segments locally stored by said client player, and means for transmitting a 
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request to said server subsystem for programs segments specified in said program 
schedule but not locally stored by said client player. 

18. A personalized electronic information delivery system as set forth in claim 1 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes means for processing said 
usage log to produce billing information for said subscriber. 

19. A personalized electronic information delivery system as set forth in claim 1 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said catalog 
of suggested program segments at least some of the program segments identified on said 
usage log as having been played. 

20. A personalized electronic information delivery system as set forth in claim 14 
wherein said client player system includes means for re cording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said 
program schedule at least some of the program segments identified on said usage log as 
having been played. 

21. A personalized electronic information delivery system comprising, in combination, 
an Internet host subsystem comprising: 

afile storage server for storing a plurality of program segments, at least some of 
which include natural language text recorded in digital compressed form and stored as 
named retrievable files, 

means for storing a category description for each of a plurality of subject matter 
categories,. 
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means for storing a program description of the information content of each of said 
program segments, each of said program descriptions including the identification of one 
or more of said subject matter categories to which the described program segment 
belongs, 

means for storing a subscriber description of at least one subscriber, said 
subscriber description containing information indicative of particular subject matter 
categories designated as being of interest to said subscriber, 

means for compiling a personalized catalog of suggested program segments for 
use by said subscriber, said personalized catalog consisting of category descriptions and 
program descriptions selected in accordance with said subscriber description, 
a port for establishing a data communications pathway to the Internet, 
means for transferring said personalized catalog to said subscriber, and 
means for transmitting identified ones of said program segments to said subscriber 
upon request, and 

a client player device accessible to said subscriber at a geographic location remote 
from said host subsystem, said player device comprising, in combination: 

means for establishing a data transfer connection via the Internet between said 
player device and said Internet host subsystem, > 

means for transferring information describing said subscriber to said host system 
for inclusion in said subscriber description, 

means for transmitting to said host system a request for a said personalized 
catalog, 

means for receiving the requested catalog from said host subsystem, 

means for transmitting said to said host system a request for one or more desired 

program segments selected from the suggested program segments in the requested 

catalog, and 

means for receiving said desired program segments from said host system, and 
means for reproducing said natural language text in a form comprehensible to a 
human user from selected ones of said program segments. 
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22. A personalized electronic information delivery system as set forth in claim 21 
wherein said natural language text recorded m compressed form cona^ 
recording of spoken natural language text. 

5 23,. A system as set forth in claim 22 wherein said hdst subsystem further includes 
means for storing digital data representing a transcript of at least a portion of the spoken 
natural language text recorded in at least some of said program segments. 

24. A personalized electronic information delivery system as set forth in claim 21 
10 wherein said natural language text recorded in compressed form consists of digital data 

representing a sequence of words expressed as text characters and wherein said means for 
reproducing said natural language text in a form comprehensible to a human user 
comprises speech synthesis means for converting said word into audible spoken form 
understandable to a human listener. 

15 

25. A personalized electronic information delivery system as set forth in claim 21 
wherein said subscriber descriptions include information describing the attributes of a 
given subscriber and wherein at least selected ones of said program descriptions contain 
subscriber attribute information specifying the attributes of subscribers to whom the 

20 described program segment may be of interest, and wherein said means for compiling a 
personalized catalog includes means for matching the attributes in said subscriber 
descriptions to the subscriber attribute information in said program descriptions. 

26. A system as set forth in claim 25 wherein said subscriber attribute information 
specifies the age of said subscriber and wherein said program descriptions specify the ages 

25 of subscribers to whom the described segment may be of interest. 

27. A system as set forth in claim 26 wherein said subscriber attribute information 
specifies the sex of said subscriber and wherein said program descriptions specify the sex 
of subscribers to whom the described segment may be of interest. 

30 
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28. A system as set forth in claim 27 wherein said subscriber attribute information 
specifies the marital status of said subscriber and wherein said program descriptions 
specify the marital statos of subscribers to whom the described segment may be of 
interest. 

29. A system as set forth in claim 28 wherein said subscriber attribute information 
^es the geographic location of said subscriber and wherein said program descriptions 
specify the geographic location of subscribers to whom the described segment may be of 

interest. - . 

30. A persoiialfced electronic informatioii delivery system as set forth in claim 21 
"herein at least some of said category descriptions further contain information indicative 
of other cross-referenced subject matter categories to which the described category is 
related and wherein said means for compiling said catalog includes means for including 
said cross-referenced category descriptions in said catalog. 

31. A personalized electronic information delivery system as set forth ui claim 21 
wherein said data communications pathway is a digital transmission system and wherein 
said file storage server stores said programs in identified files which may be transmitted 
via said digital transmission system. 

32. Apersoijalizeddectroiiiciiiformationde 31 
vmerein each of said program descriptions includes means for ideiitifying one or more files 
«ored on said file storage server which relate to me program segmemdes(ribed by that 

program description, 

33. A personalized electronic information delivery system as set forth in claim 21 
wherein said host subsystem further comprises: 

means for receiving from a subscriber via said communications pathway a search 
request for the identification of program segments satisfying criteria specified in said 
search request, 
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means for compiling a listing of said programs satisfying said criteria, and 
means for transmitting said listing to that subscriber which issued said search 
request. 

34. A personalized electronic information delivery system as set forth in claim* 21 
wherein said host subsystem further comprises means for compiling a program schedule 
consisting of an ordered sequence of selected ones of said program segments and means 
for transferring said program schedule to said client player- via said communications 
pathway, and wherein said client player includes means for reproducing said selected ones 
of said program segments. 

35. A system as set forth in claim 34 wherein said client player includes means for 
reproducing said selected ones of said program segments in the order specified in said 
program schedule. 

36. A.system as set forth in claim 34 wherein said client player includes means for 
altering said program schedule to form an edited schedule and means for reproducing the 
program segments in the order specified in said edited schedule 

37. A system as set forth in claim 34 wherein said client player includes means locally 
storing program segments received from said host subsystem, means for comparing the 
specification of program segments contained in said program schedule with the identity 
of program segments locally stored by said client player, and means for transmitting a 
request to said server subsystem for programs segments specified in said program 
schedule but not locally stored by said client player. 

38. A personalized electronic information delivery system as set forth in claim 21 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes means for processing said 
usage log to produce billing information for said subscriber. 
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39. A personalized electronic information delivery system as set forth in claim 21 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said catalog 
of suggested program segments at least some of the program segments identified on said 
usage log as having been played. 

> 

40. A personalized electronic information delivery system as set forth in claim 37 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said 
program schedule at least some of the program segments identified on said usage log as 
having been played. 

41 . A communications system for distributing audio recordings among a plurality of 
system subscriber stations located remotely from one another, said system comprising: 

a communications network interconnecting said system subscribers, 

a subscriber access device connected to said network at each of said subscriber 
stations, said access device comprising: . 

playback means for reproducing a selected audio recording received from said 
network for a listener* 

input means for accepting a spoken message from said listener concurrently with 
the reproduction of said selected audio recording, 

means for recording said spoken message and identification data associating said 
spoken message with said selected audio recording to form a subscriber generated 
recording, and 

means for transmitting said subscriber generated recording over said network, and 
routing means coupled to said network and responsive to said identification data for 
transferring said subscriber generated recording to one or more of said subscribers. . 
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42.. A communications system as set forth in claim 41 wherein said spoken message 
is an audio annotation to be appended to said selected audio recording and wherein said 
identification data includes the specification of a chosen position in said selected audio 
recording to which said audio annotation relates. 

.43. A communications system as set forth in claim 42 wherein said input means 
includes means actuated by said listener for initiating the acceptance of said spoken 
message and wherein said chosen position is the position in said selected audio recording 
being reproduced when said acceptance was initiated by said listener. 

44. A communications system as set forth in claim 42 wherein said routing means 
includes means for transferring said subscriber generated recording of said audio 
annotation to subscribers who thereafter receive transfers of said selected audio recording. 

45. A communications system as set forth in claim 44 wherein said playback means 
includes means responsive the receipt of a subscriber generated recording of an audio 
annotation for playing said audio annotation when said position is reached during the 
playback of said selected audio recording. 

46. A communications system as set forth in claim 41 wherein said identification data 
is indicative of at least one subject matter category and wherein said routing means 
includes: 

means for storing data identifying a subset of subscribers having an interest in 
information within said one subject matter category, and 

means for transferring said subscriber generated recording to one or more of said 
subscribers in said subset 

47. A conmainications system as set forth in claim 46 wherein said at least one subject 
matter category is a subject matter category associated with said selected audio recording. 
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48. A communications system as set forth in claim 46 wherein said routing means for 
transferring said subscriber generated recording to said subscribers in said subset includes 
means responsive to preference data supplied by a receiving subscriber for encouraging 
or inhibiting the transfer of said subscriber generated recording to said receiving 
subscriber. 

49. A communications system as set forth in claim 41 wherein said selected audio 
recording was produced by an originating subscriber and wherein said routing means 
incbdesnieaiisfortiaiisferring 

originating subscriber. 

50. A communications system as set forth in claim 49 further including means for 
storing the identification of a subset of subscribers who have an interest in each of a 
plurality of subject matter topics, wherein said identification data further includes the 
specification of one or more subject matter topics to which said subscriber generated 
recordings relate, and further including means for transferring to those subscribers having 
anintoertagrventopicanide^ 

the specification of said given topic. 

51. Apparatus for exchanging information relating to a plurality of subject matter 
topics between a plurality of participants located remotely from one another, said 
apparatus comprising, in combination: 

an electronic data communications network interconnecting said participants, 
one or more audio recording units coupled to said network for recording audio 

messages spoken by each of said participants, 

means for persistently storing each given one of said audio messages with 

identification data designating one or more of said subject matter topics to which said 

given audio message relates, 
<: means for providing to a requesting participant an identification of previously 

stored messages relating to a subject matter topic specified in a request for information, 

and 
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an audio playback unit for reproducing stored messages specified in said 
identification. 



52. Apparatus as set forth in claim 5 1 wherein each of said audio recording units 
5 includes means operable by a participant for recording a comment relating to a particular 
previously stored message wherein the identification data stored with said comment 
designates one or more of the subject matter topics to which said previously stored 
message relates. 

< ... 

10 53. Apparatus as set forth in claim 52 further bcluding: 

means for persistently storing pre-recorded programs each of which relates to one 
or more of said subject matter topics, and 

means for additionally providing a requesting partitipant an Mentification of pre- 
recorded programs relating to a subject matter topic specffied ma request for information. 

15 

54. Apparatus for otrtaininginfoimation responsive to request f^^ 
which comprises, in combination, 

means for recording said request for information as an audio recording containing 
a spoken request prompt and a recorded request marker specifying a position in said audio 
20 recording subsequent to said request prompt, 

playback means for reproducing said spoken request prompt for a listener, 
input means initiated by.said recorded request marker for temporarily suspending 

the operation of said playback means while accepting a spoken response from said listener, 

and 

25 recording means for storing said spoken response together with identification data 

designating said request. 

55; Apparatus as set forth in claim 54 whereto sud identification data comprises a 
designation of said audio recording and a designation of the position of said request 
30 marker in said audio recording. 
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56. Apparatus as set forth in claim 54 wherein said input means further comprises 
means actuated by said listener for initiating the acceptance of a spoken message and 
wherein said recording means further comprises means for storing said spoken message 
together with a designation of said audio recording and a designation of the position in 

5 said audio recording at which the acceptance of said spoken message was initiated by said 
listener. 

57. A method for producing and processing an audio questionnaire comprising, in 
combination, the steps of: ... 

storing an electronically readable file of text characters consisting of natural 
10 language text and at least one response request marker radicating a position relative to 
said natural language text where a response is to be inserted by a human listener, 

using speech synthesis processing to convert smd electronically readable fUe of ^ 
characters into a corresponding audio file of spoken natural language, 
coiwertii« said response request markwrn 
15 data indicating said position in said audio file, 

reproducing said audio file for said human listener, 

temporarily suspending the reproduction of said audio file at said position in said 
audio file indicated by said timing data, and 

accepting and recording a spoken response from said listener while said 
20 reproduction is temporarily suspended. 

58. A method as set forth in claim 57 for producing and processing an audio 
questionnaire wherein said response request marker further specifies a selected one of a 
group of predetermined response types. 

25 59. A method as set forth in claim 58 wherein said a group of predetermined response 
types includes a spoken response recorded stored as an aU(fio rerording and a spoken 
response recorded as a one a predetermined set of data values. 
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60. A system for storing and reproducing audio programming concurrently with the 
synchronized display of one or more stored images which comprises, in combination,. 

means for storing sequential digital data representing an audio program, 

means for storing a digital data representing an visible image, 

means for storing synchronizing information specifying a limited portion of said 

sequential digital data representing a designated passage within said audio program, 
audio player means for reproducing said audio program by converting said 

sequential digital data into audible form, and 

means for visually displaying said image data concurrently with the reproduction 
of said designated passage. 

61. A system for storing and reproducing audio programming as set forth in claim 1 
wherein said means for storing sequential data representing an audio program comprises 
means for storing a file of natural language text and wherein said audio player means for 
reproducing said audio program comprises speech synthesis means text file into audible 
spoken form. . 

62. A system as set forth in claim 60 wherein said synchronizing information 
comprises one or more records ideirtifying a said digital data representing said visible 
image and further identifying locations within said sequential digital data which 
correspond to the beginning and end of said designated passage. 

63. A computer system for storing and reproducing audio programming concurrently 
with the synchronized display of one or more visible images, said system comprising, in 
combination.mass storage means for storing sequential digital data representing said audio 
programming, image data representing said visible image, and syncliroiiizing data relating 
said image data to an identifiable contiguous portion of said sequential file, 

a display for converting said image data into said visible image, and 

processing means ^pro?essing means for ronvertmg 
into an audible signal and for activating said .display means to display said visible image 
beginning and ending at times specified by said synchronizing data. 
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64. Asystem for storing and reproducing audio programming M set forth m daim. 4 
vvheremsaidmeans for storing sequential data representing an audio program^ 
means for stor^ame of naturd language text^^ 

reproducmg said audio program comprises speech synthesis means text file into audible 
spoken form. 

65. - A computer system for producing an audio program concurrently with the display 
ofoneori^imagessyiich^ 

means for storing a sequential digital file representing natural language text 
mcorporating at predetennined positions therein unique tag characters designating marked 
positions in said -natural language text, 

means for storing image data representing one or more visual images, : 
speech synthesis means for converting said sequential digital file into audible speech 
representing said natural language text in spoken form, and 

means for detecting the presence of said imique tag charactera m sdd sequent^ 
digital file to produce one or more control values, and 

display means response to said control values for producing said visual images at times 
predetermined times relative to said audible speech. 

66. A computer system as set forth in claim 65 wherein said sequential digital file 
"presenting natu^ 

which is displayable and printable using a conventional web browser. 

67. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language image tags of the form <IMG SRO=TmageID"> where 
Image© is a symbolic variable identifying image data for a particular visual image and 
wherem the position of each such image tag specifies the time relative to said audible 
speech when said visual image is displayed by said display means. 
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68. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language text formatting tags which specify particular highlight 
passages in said natural language text and further including means for detecting said 
formatting tags to produce playback control values and means responsive to said playback 
control values to selectively reproduce said highlight passages in spoken form. 

69. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language link markers which specify particular anchor passages in said 
natural language text and further including means for detecting said link markers to 
produce link control values and means jointly responsive to said link control values and 
to a requestfrom a user for performing a jump to different position in said digital 
sequential file at which different position said speech synthesis means continues the 
conversion of said sequential digital file into audible speech. 

70. A computer system as set forth in claim 67 wherein said tag markers further 
include hypertext markup language text formatting tags which specify particular highlight 
passages in said natural language text and further mduding means for detecting said 
fonnatting tags to produce playback control values and means responsiye to said playback 
control values to selectively reproduce said highlight passages in spoken form. 

71. A computer system as set forth in claim 67 wherein said tag markers include 
hypertext markup language link markers which specify particular anchor passages in said 
natural language text and further including means for detecting said link markers to 
produce link control values and means jointly responsive to said link control values and 
to a request from a user for performing a jump to different position in said digital 
sequential file at which different position said speech synthesis means continues the 
conversion of said sequential digital file into audible speech. 

72. A system for storing and reproducing natural language text in both spoken and 
written which comprises, in combination, 
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means fer storing sequential digital data representing an audio program containing 
spoken text, 

means for storing a dighal data represent^ a sequent 
transcript of said spoken text in said audio program, 

means for storing synchronizing information specifying the lo cation of at least one 
designated spoken passage in said audio program and a location of the corresponding 
sequence of characters in said transcript corresponding to said spoken passage, 
audio player means for reproducing said audio program by converting said sequential 
digital data into audible form, and 

means responsive to said synchronizing information for visually displaying said 
wtresponding sequence of characters concurrently with the reproduction of said 
designated spoken passage. 

73. Apparatus as set forth in claim 72 including means responsive to the designation 
of a target sequence of characters for searching said transcript for a matching sequence 
of characters equivalent to said target sequence, and means for reproducing a portion of 
said audio program containing a spoken passage corresponding to said matching sequence 
of characters in said transcript. 



74. A system for delivering pre-recorded programs to a subscriber comprising, in 
combination: 



1 ^ 810 ** a ***** of a plurality of separate program 'segments, 

means for storing category ^^i^ikm^utha^ctm^nmlJt 
categories, 

means for storing program description ^sptd^uk^o^ofsdds^tct 

matter categories to which each of said program relates, 

means for storing data describing a plurality of subscribers, including data 
desigiiating at least one of said categories for each of said subscribers, 

meansforcoinparingsaiddata 
with said program description data to compile an identification of program segments of 
potential interest to said given subscriber, 
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means for transferring said identification of programs to said given subscriber, 
means responsive to a request from a subscriber for transferring requested 

program segments from said library to the requesting subscriber, and 

means for receiving from said requesting subscriber a usage log identifying the 

program segments actually used by said requesting subscriber. 

75. A system as set forth in claim 74 wherein said identification of programs 
transferred to said subscriber comprises a program schedule consisting of an ordered 
sequence of program identifiers: 

76. A system as set forth in claim 75 further includes a player device accessible to each 
of said subscribers for reproducing said program segments specified by said program 
identifiers in the order specified by said program schedule. 

77. A system as set forth in claim 75 further including means for excluding from said 
program schedule for any subscriber the identification of any program segment previously 
identified as actually used by that subscriber in a usage log. 

78. A system as set forth in claim 77 wherein said program schedule comprises 
programs*** in said specification received from said given subscriber and further 
comprises additional programs selected by comparing said data describing said given 
subscriber with said program description data. 
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A system for delivering pre-recorded prograiiis to a subscn^er comprising, a host 



means for storing a library consisting of a plurality of separate program segments, 
means for storing category definition data describing a plurality of subject matter 
categories, 

means for storing program description data specifying, for each gi ven one of said 
program segments, at least one of said subject matter categories to which said given one 
of said program segments relates, 
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means for storing subscriber data describing a plurality of subscribers, including data 
designating at least one of said categories for each of said subscribers, 

means for comparing said data describing at least a given one of said subscribers 
with said program description data to compile a catalog of program segments, each 
catalog containing an identification of a set of program segments of potential interest to 
said given subscriber and a narrative description of the programs segments identified in 
said catalog, 

means for transmitting said catalog to said given subscriber, 
means for receiving from said given subscriber a specification of programs identified 
in said catalog, 

means for transmitting to said given subscriber a program schedule consisting of an 
ordered sequence of program identifications, and 

means responsive to a request from said given subscriber for transferring requested 
program segments from said library to said given subscriber, and 

a player device accessible to said given subscriber for selectively reproducing said 
program segments specified by said program identifiers in the order specified by said 
program schedule, said player device further comprising: 

recording means coupled to said player device for recording a usage log containing 
an identification of each program segment actually played by said player device, and 

means for transmitting said usage log to sad host subsystem. 

80. A system as set forth in claim 79 including local storage means accessible to said 
player device for storing program segments transferred from said library to said given 
subscriber. 

81. A system as set forth in claim 79 further includes a player device further includes 
editing means operable by said subscriber for modifying said program schedule. 

82. A system as set forth in claim 80 further including means for excluding from said 
program schedule for any subscriber the identification of any program segment previously 
identified as actually used by that subscriber in a usage log. 
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83 : A system as set forth in claim 79 wherein said program schedule comprises 
programs in said specification received from said given subscriber and further comprises 
additional programs selected by comparing said data describing said given subscriber with 
said program description data. 

84. A system as set forth in claim 82 further including means for excluding from said 
program schedule and said catalog for any subscriber the identification of any program 
segment previously identified as actually used by that subscriber in a usage log. 

85. A system as set forth in claim 79 further including means for processing said usage 
logs to adaptively modifying said subscriber data to indicate of the character of programs 
actually used by each of said subscribers. 

86. A system for delivering pre-recorded programs to a subscriber comprising, in 
combination: 

means for storing a library consisting of a phindity of separate program segments, 
means for storing category definition data describing a plurality of subject matter 
categories, 

means for storing program description data specifying at least one of said subject 

matter categories to which each of said programs relates, 

means for storing subscriber data describing a plurality of subscribers, including data 
designating at least one of said categories for each of said subscribers, 

means .for comparing said data descn^ at least a given one of said subscribers 
with said program description data to compile a catalog of program segments, each 
catalog containing an identification of a set of program segments of potential interest to 
said given subscriber and a narrative description of programs segments identified in said 
catalog, 

means for transmitting said catalog to.said given subscriber, 
; means operable by said given subscriber for selecting a set of desired program 
segments from said catalog, 
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means for receiving from said given subscriber a specification said set of desired 
programs, 

means for transmitting to said given subscriber a program schedule consisting of an 
ordered sequence of program identifications, 

means responsive to a request from a subscriber for transferring requested program 
segments from said library to the requesting subscriber, and 

means for receiving from said requesting subsmT,er a usage log ide^tirying the 
program segments actually used by said requesting subscriber. 

87. Asystemassetforthinclaim 86 further includes a player device accessible to each 
of said subscribers for reproducing said program segments specified by said program 
identifiers in the order specified by said program schedule. 

88. A system as set forth m^^ 
I^scheduleforanysubsctiberthe 

identified as actually used by that subscriber in a usage log. 

89. AsystemassetformmclaimgevAer^ 

m said specification received from said given subscriber and further comprises additional 
programs selected by comparing said data describing said given subscriber with said 
program description data. 

90. A system as set forth in claim 89 further including means for excluding from said 
program schedule and said catalog for any subscriber the identification of any program 
segment identified as actually used by that subscriber in a usage log. 

91. A system as set forth in claim 86 further mcmaing means for processing said usage 

logstoadaptivdymodifysaidsubscriberdata to mdicateofme character of programs 
actually used by said subscribers. 
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92. A system as set forth in claim 86 wherein said subscriber data further includes data 
indicating the total duration of playing time available to at least selected ones of said 
subscribers and means for limiting the playable duration of the program segments 
identified in said ordered sequence in accordance with said total duration. 

93 . A system as set forth in claim 91 further includes means responsive to said usage log 
for modifying said playable duration in accordance with the percentage of segments 
previously skipped by said requesting subscriber. 

94. A system as set forth in claim 86 including means for transmitting to said subscriber 
an indication of optimum times for requestmgthetraiisfer of requested program segments. 

95. A system as set forth in claim 86 further wherein said subscriber data further 
comprises an indication the time of day when a playing session is scheduled to begin for 
said requesting subscriber on each day of the week. 

96. A system as set forth in claim 95 wherein said subscriber data further comprises an 
indication of the expected duration of said playing session for said requesting subscriber 
on each day of the week. 

97. A player for reproducing selected audio program segments comprising, in 
combination: 

means for storing a plurality of program segments, each of said program segments 
having a beginning and an end, 

means for storing data establishing a sequence in which said program segments are 
scheduled to be reproduced by said player, 

means for accepting control commands from a user of said player, 

means for reproducing said program segments in the order established by said 
sequence in the absence of a control command, 

means for detecting a first command indicative of a request to skip forward, and 
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mem, responsive ,o add tot con.™™) for discontimjing the reproduction of the 

Playing program segment and taaead coding the reproduction at the 
b.guu^ 0 f. pr „ gram ^^^ w ^ d( ^ ^ 

sequence. 

98.. Ap^MWhd^S,^^^,^^^ 
command indicative of a request to Aip backward, and 

mem, respond to . singU, m „f „,„ c«nn^ fe, dfec™^ a,, 
reproduction of 4. curreutty plying, progran ^ ^ ^ ^ 
reproduction at the beginning of said currently playing program. 

detechon of two conserve ones of add second command, for discontinuing the 
reproduction of the currently playing program segment and instead continuing the 

"I^^-ti^b^nnmgofaprognm .egmem^ch precede, ^onrenuyp,^ 

program segment 

100. Ap%eTa,se.forti.toclaim97^^^ uence ^^^^ ddata 
forms an endless circular sequence of program segments. 

A player as set forth in claim 97 including editing means for modifying said data 

establishing said sequence. 

Mtt .tlMMMkMiAl ^^editmgmeansmctodesmeansfo, 
reordering the sequence established by said data. 

reproduced. 
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104. Aplayer as set forth in claim 103 wherein said means for varying the rate at which 
said program segments are reproduced includes means for skipping periods of silence 
between words or other sounds when said program segments are reproduced. • 

105. A player as set forth in claim 103 wherein said means for varying said rate 
comprises means for designating portions of said program segments as highlight passages 
and means responsive to a request from aid user for reproducing said highlight passages 
without reproducing at least some portions of said program segments which are adjacent 

to said highlight passages. 

106. A player as set forth in daim 97 wherein said means for reproducing said program 
segments including means for accepting a bookmarking request from said user, means for 
storing bookmark data indicating the program segment being reproduced at the time said 
bookmarking request is accepted. 

107. A player as set forth in claim 97 wherein said program segments include 
descriptive program segments, each given descriptive segment containing information 
which when reproduced for the listener describes the content of one. or more other 
program segments Which immediate follow said given descriptive segment, and 

wherein said player fiirther comprises means responsive to said first command and 
operative when one of said descriptive segments is aiaentfy playing for discontmu^ 
reproduction of said currently playing descriptive segment and instead continuing the 
reproduction at the beginning of the next descriptive segment in said sequence. 

108. * pUyer as set forth belaud 
means for storing data indicative of 

of said program segments, and 

means responsive to a predetermined one of said control commands for 
reproducing only the highlight passages within said selected program segments. 
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109. A player as set forth in claim 97 wherein w ~ 

^••*-^-«*- w «^ (1 «. -1Ml(l . w ^; ,,, r 

Process^ means for translating said digitallv recorrlM „,,(• 

"guns delivered to said output means for rwrodudnii asiin^u 

J TO ^^^^ to . fc ; M e6f^ C o atolcom ^ fer 

<to„ 14 tober compnsing me™ respoasive ,0 two conserve OMS of.-. „ ! 
"""■^P^WIirogrammsiidsequeiice. 

.^feco^ofoaeo.n.ot.outerp™^^^^ 
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said descriptive segment in said sequence and wherein said processing means responsive 
to said a first one of said control commands continues the translation at the beginning of 
the next descriptive command when the currently playing program segment is a descriptive 
segment. 

113. A programmed digital computer as set forth in claim 1 6 wherein said input means 
comprise a microphone for accepting voice commands spoken by said user. 

- 114. A player device for mteractivery reproducing selected audio program segments 
from a program library comprising, in combination: 

storage means for storing a plurality of program segments each containing an 
audio presentation; 

means for storing a program schedule estabhshing an ordered sequence of said 
program segments to form a continuously playable audio program session; 

output means for converting the audio presentation at a current playback position 
15 in said session into an audible form perceivable by a listener, 

means for identifying at least pne hyperlink anchor passage within said session; 
means for associating said anchor passage with a linked playback position in said 
session different from the playback position of said anchor passage; 

means for producing an output indication perceivable to said listener whenever 
said hyperlink anchor passage is reproduced by said output means; 

input means for accepting a hyperlink execution commands from a listener, and 
means responsive to said execution command for changing said current playback position 
in said session to said linked playback position. 

25 1 15. A player device as set fr>rth in claim 1 14 wherein said output indication is an 
audible cue signal produced in timed relation to the reproduction of said anchor passage. 

116. A player device as set forth in claim 1 14 wherein said means for identifying said 
anchor passage comprises an anchor passage ideiitifier stored wrm said program schedule. 
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a library server storing said i>rogram library; 
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input means for accepting a hvneriinlr 
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m said session to said linked playback position. 
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120. A player device as set forth in claim 1 19 wherein said output indication is an audible 
cue signal produced in timed relation to the reproduction of said anchor passage. 

121. A player device as set forth in claim 1 19 wherein said means for identifying said 
anchor passage comprises an anchor passage identifier stored with said program schedule. 

122. A player device as set forth in claim 121 further comprising means for identifying 
a plurality of highlight passages within session, and means responsive to a request from 
said listener for playing said highlight passages without playing other portions of said 
session. 



123. A player device set forth in claim 119 including means for identifying subject 
description passages within said session, each given descriptive passage containing 
information describing of a portion of said session which follows said given descriptive 
passage, and means responsive to a request from said listener for reproducing the next 

15 descriptive passage in said session following said current playback position in said session. 

124. A player device as set forth in claim 119 wherein said library server includes means 
for producing said program schedule and said player device includes means for receiving 
said program schedule from said library server. 



125 . A system for reproducing selected program segments containing audio presentations 
from a program library comprising, in combination: 
a library server storing said program library, 

a communications facility for transferring program segments from said library server 
to player devices located remotely from said program library, each of said player devices 
25 comprising: 

means for receiving a plurality of program segments from said library server via said 
communications facility 
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for .dott^g « ta, one ^ ^ ^ ^ ^ ^ 

^ ga^ 1 ^^ mea us for converdng the audio presentation at a current p'laybackposition 
m a^ .esa,™ into m ^le fom perceivabIe ^ , Haener 

— "'^^h^^arn^ewidu,^ se^on; 

•OMonifl^^ttep,^^^^^^^ 

^^l^^^^s^pe^*^,^^^^ 
IWertot^ rp ^ isr(5ro ^ by ^ d ^ iw 

input means for accepting a hyperlink execution commands from a listener* and 
m .aid seas™ to Mid Imked playback position. 

126. Apl^de^^setforthind™ 125 to** a,^^^ 
.id teener ftr ^ ^ ^ ^ ^ 



session. 



«». ^ A player device set forth in claim ,26 incbdingme™ for idenlifying subject 
P^e, am, mea* ^sponsive u, a reuues, ftom .* li^er for reproducing the next 

fcr^aa.dp^^^^^^^^^ 
said program schedule ftoin said fibnuy server. 
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a mass storage device for storing a plurality of digitally recorded audio program 
segments, each of said segments haying a beginning and an end, and further storing data 
establishing a sequence in which said program segments are scheduled to be played, 

means for storing an associated program type designation for each of said recorded 
audio program: segments, 

input means for accepting control commands from a user, 
output means for producing audible sounds in response to analog audio signals, 
processing means for translating said digitally recorded audio program segments into 
analog audio signals delivered to said output means for reproducing said recorded 
program segments in a form audible to said user, said processing means being responsive 
to a user request for selectively inhibiting the reproduction of program segments specified 
by said user request . 

130.. An audio program player as set forth in claim 129 wherein said program type 
designations include designations of announcement program segments and wherein said 
means for selectively inhibiting comprises means for inhibiting the reproduction of 
program segments designated as being announcement program segments. 

131. An audio program player as set forth in claim 129 wherein said program type 
designations include designations of advertisement program segments and wherein said 
means for selectively inhibiting comprises means for biMnting the reproduction of 
program segments designated as being advertisement program segments. 

132. A system for reproducing selected program segments containing audio presentations 
from a program library comprising, in combination: 

a library server storing said program library; 

a cmmunications facility for transferring selected program segments from said library 
server to player devices located remotely from said program library in response to 
program segment requests from said player devices, each of said player devices 
comprising: 
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communications facility. 

local storage mam. for coring program ^ ^a^y^ 
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phrata, of program ^tttota.coatoo^p^^^^^. 

» and session into an audible form perceivable by a Eitener, 

me™ for identify^ missing p rogrim idenmlrf as being vrfUfc s»d 

ordered '^bm^aren^^M^^^^ ^^^ 
transmmtag . rapes, ^ ^ B ^ ag prognm agucaal0aiimmymnr 

133. A ^ten»roduc^ 
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134. A method for infcracnveiy presemtag a pilnltty WttM e audio programming 
segments to a listener oomprismg, in combination, the steps of 

«oring each of said separate programming segments as. ffle of digital data, 
^'^^rfconWrecords^^.p^.^^^ 
said programming segments are to be reproduced, 
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»^ passage in on. of smd files and the location of th. beginntag of an associated 
linked passage in one of said files, 

said first set of control records, 
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wththepresentationof said anchor passage, and 

nsunxing the presentation of said segments at the location of the begimung of said 
asodated linked passage. * 
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135. The method as set forth in claim 134 further including the step of accepting a skip 
command from said listener during the presentation of at least selected ones of said 
programming segments and resuming the presentation of said segments at the beginning 
of the next segment in said proposed sequence in response to said skip command. 

136. The method of claim 135 further wherein some of said segments are subject 
description segments which precede programming segments described thereby, said 
method further comprising the step, performed in response to said skip command when 
a subject description segment is being presented, of resuming the presentation of said 
segments at the beginning of the next subject description segment in said proposed 
sequence. 

137. The method of claim 134 further comprising the step of storing a file of digital data 
representing a file of natural language characters forming a transcript of at least a 
transcribed one of said audio programming segments and further storing a third set of data 
representing locations within said transcribed audio program segment of corresponding 
locations in said file of characters. 

138. The method of claim 137 including the step of displaying said natural language text 
to said user, accepting from said listener the designation of a selected location within said 
displayed file of natural language text, and responsive to said designation presenting said 
transcribed audio segment to said listener at a position in said transcribed audio segment 
corresponding to said selected location in said file of characters. 
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